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1. Introduction 



For a given integer N > 2 and a given sequence X := {Xk,k e Z) 
of random variables defined on a probability space {Q,J^,P), the random 
variables Xk,k e Z are said to be 'W-tuplewise independent" if for ev- 
ery choice of distinct integers k{l), k{2), . . . , k{N), the random variables 
X^i^, X^(2), • • • , -^fe(iv)) cire independent. For N — 2 (resp. A'" = 3), the word 
'W-tuplewise" is also expressed as "pairwise" (resp. "triplewise" ) . 

Etemadi [14] proved a strong law of large numbers for sequences of 
pairwise independent, identically distributed random variables with finite 
absolute first moment. Janson [19] showed with several classes of coun- 
terexamples that for strictly stationary sequences of pairwise independent, 
nondegenerate, square-integrable random variables, the Central Limit The- 
orem (henceforth abbreviated CLT) need not hold. Subsequently, the au- 
thor [3, Theorem 1] constructed another such counterexample, a 3-state one 
that has the additional property of satisfying the absolute regularity (weak 
Bernoulli) condition. (The definition of that condition will be given later in 
this Introduction.) Yet another counterexample was constructed by Cuesta 
and Matran [10, Section 2.3], a construction based on elementary number- 
theoretic properties of addition on {0, 1, . . . ,p—l} mod p, where p is a prime 
number. 

For an arbitrary fixed integer A'" > 3, Pruss [28] constructed a (not 
strictly stationary) sequence of bounded, nondegenerate, A'"-tuplewise inde- 
pendent, identically distributed random variables for which the CLT fails to 
hold. In that paper, Pruss left open the question whether, for any integer 
iV > 3, a strictly stationary counterexample exists. For = 3, the author 
[4, Theorem 1] answered that question affirmatively by showing that the 
counterexample in [3, Theorem 1] alluded to above is in fact triplewise in- 
dependent. Recently, the author and Pruss [6] have answered that question 
affirmatively for arbitrary N > 3, with a (strictly stationary) counterexample 
adapted from the (nonstationary) one in Pruss [28]. 
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In a similar spirit, for an arbitrary integer N > 2, Flaminio [16] con- 
structed a (nondegenerate) strictly stationary, finite-state, A'"-tuplewise inde- 
pendent random sequence X := {Xk, k E Z) which also has zero entropy and 
is mixing (in the ergo die-theoretic sense). That paper explicitly left open 
the question of whether those examples satisfy the CLT. 

In this paper here, a (nondegenerate) strictly stationary, 5-tuplewise 
independent counterexample to the CLT will be constructed which is finite- 
state and has the extra property of being "causal" and therefore "Bernoulli." 
The interest in the property of "Bernoulli," for (finite-state) A^-tuplewise in- 
dependent counterexamples to the CLT, was suggested to the author by Jon 
Aaronson and Benjamin Weiss. There does not seem to be a visible way of 
constructing such a (strictly stationary) finite-state Bernoulli counterexam- 
ple which is A^-tuplewise independent for any given > 6. The techniques 
in the example given here do not appear to adapt effectively to > 6; and 
there is no visible way of adapting the recent example of the author and 
Pruss [6] alluded to above, into one that is (finite-state and) Bernoulli. The 
example given here will also have the further property of possessing a triv- 
ial double tail cr-field. (The terms "causal," "Bernoulli," and "double tail 
(j-field" will be defined below.) 

The main result and comments on it. Before the result is stated, some 
notations will be needed. 

Let N denote the set of all positive integers. Let TZ denote the Borel 
cr-field on the real number line R. The notation =^ will mean convergence 
in distribution. 

Suppose X := {X^^k e Z) is a sequence of random variables on a 
probability space (f2,.F, P). For each positive integer n, define the partial 
sum 

(LI) Sn := S{X, n) := Xi + X2 + . . . + X„. 

Also, for — oo < J < L < oo, let J^j denote the cr-field C generated by 
the random variables Xk, J < k < L {k E Z). The "double tail cr-field" of 
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the sequence X is 

(1-2) rdouble(^) := n (-^-^ V ^n~)- 

A cr-field A<ZT is said to be "trivial" if P(^) = or 1 for every A e A. 
Here is our main result: 

Theorem 1.1. There exists a strictly stationary sequence X := (Xk, 
e Z) o/ random variables (on some probability space {Q,J-',P)) with the 
following six properties: 

(A) The random variables Xk take just the values —1 and 1, with P{Xo = 
-1) = P{Xo = 1) = 1/2 (and hence EXq = and EX^ = 1 ). 

(B) For every five distinct integers A;(l), A;(2), A;(3), A;(4), and k{b), the 
five random variables Xi^^i^, -^fc(2)7 -^fc(3)7 -^fc(4)7 and X^j-s) are independent. 

(C) There exist a sequence {ijk^k G Z) of independent, identically dis- 
tributed real-valued random variables (on {Q, J-', P)), and a B or el function 
/:RxRxRx...^ {-1, 1}, such that for every k eZ, 

(1-3) Xk = f{r]k,r]k-i,r]k-2,---) a.s. 

(D) The double tail a-field of X is trivial (that is, P{A) — Q or 1 for 
every A e Trouble (^)j- 

(E) One has that limsup^^o^ E{Sn/y/n)^ < 15. 

(F) For every infinite set Q C N, there exist an infinite set T <Z Q 
and a nondegenerate, non-normal probability measure jjL on (R, IZ) such that 
Sn/ ^ n as n ^ oo, n ^ T. 

Here are some comments on the various properties in this theorem — 
starting with properties (A), (B), (E), and (F), the ones most closely tied to 
the central limit question. 

First, by property (A), in our look at the central limit question in con- 
nection with this example, the natural normalization of the partial sums is 
Sn/Vn. 
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Property (B) in Theorem 1.1 is of course 5-tuplewise independence. For 
N > 6, the question of possible existence of a similar, strictly stationary, 
A^-tuplewise independent counterexample — including properties (C) and 

(D) — remains open. The techniques in the construction for Theorem 1.1 
do not appear to extend effectively to N > 6. As a comparison, for a given 
arbitrary fixed positive integer AT, the paper of the author and Pruss [6] gives 
a construction of a strictly stationary sequence in which (i) the random vari- 
ables are uniformly distributed on the interval [— \/3, \/3] (and hence have 
mean and variance 1), (ii) the sequence satisfies A^-tuplewise independence, 
and (iii) the sequence satisfies property (F) (as well as a variant of property 

(E) ) in Theorem 1.1; that sequence satisfies ergodicity (as was shown in [6]), 
but does not satisfy property (C) (suitably reformulated) or property (D) in 
Theorem 1.1. 

Property (E) may seem rather pointless at first. However, property (F) 
is an elementary consequence of properties (A), (B), and (E) together with 
the fact that a A'"(0, 1) random variable Z satisfies EZ^ = 15. (The argument 
will be given in detail in section 9 below. An analogous argument, involving 
moments of a high even order, was used by the author and Pruss [6].) 

In property (F), the probability measure fu. may depend on the set Q. 

(As a comparison, in a couple of the pairwise independent counterexam- 
ples alluded to above — one of those in Janson [19] and the one in Cuesta 
and Matran [10, Section 2.3] — the partial sums, appropriately normalized, 
converge in distribution to a nondegenerate, non-normal law as n — > oo along 
the entire sequence of positive integers.) 

The formulation of property (F) may seem somewhat awkward. How- 
ever, properties (E) and (F) indirectly give the following information: 

(i) The family of distributions of the random variables {Sn/\/n^ n e N) 
is tight. 

(ii) There does not exist an infinite set Q C N such that S^j \fn con- 
verges to (or to any other constant) in probability as n — > oo, n & Q. 
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(iii) There does not exist an infinite set Q C N such that Sn/\/n con- 
verges in distribution to a (nondegenerate) normal law as n ^ oo, n & Q. 

(iv) By (F) and the Theorem of Types (see e.g. [1, Theorem 14.2]), there 
do not exist an infinite set Q C N and real numbers an, bn, n ^ Q, with 
6n— >ooasn— >oo, n & Q, such that {Sn — an)/bn converges in distribution 
to a nondegenerate normal law as n — > oo, n & Q. 

One can describe property (C) by saying that the random sequence X 
is "causal." Such uses of that term are well known in the literature. See e.g. 
Brockwell and Davis [7] for its use in the context of linear models in time 
series analysis. 

Properties (C) and (D) are motivated partly by the general question of 
what properties from ergodic theory can help insure that a CLT holds. In 

order to elaborate on that, we will need to give some more definitions and 
background information. 

The "Bernoulli" property. Suppose A is nonempty finite set, and X := 
(Xfc, /c G Z) is a nondegenerate strictly stationary sequence of random vari- 
ables taking their values in A. This sequence X is said to be "Bernoulli" if, 
without changing its distribution (on A^), it can be represented as a station- 
ary coding of a finite-state i.i.d. sequence — that is, if X can be represented 
in the form 

(1.4) Xk = h(^{..., Yk-i,Yk), (n+i, Yk+2, . . .)) 

for k E Z, where Y := (Yj^^k e Z) is a sequence of independent, identically 
distributed random variables taking their values in a finite set B, and h : 
B^ A is a, Borel function. (Here, a given "two sided" sequence b := 
{bk,k e Z) of elements of B is written as ((..., 60)5 (^i, ^2, •■ •)) ^is a 
convenient way to avoid ambiguity.) This is one of numerous equivalent ways 
of formulating the class of (strictly stationary, finite-state) random sequences 
that are "Bernoulli." For a list of some others, see e.g. Shields [31, p. 235, 
lines 12-15]. 
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By a special case of a classic theorem of Ornstein (see [24, p. 350, line 
11], with reference to [23]), properties ((A) and) (C) in Theorem 1.1 imply 
the Bernoulli property. That is: 

Remark 1.2. Automatically, the random sequence X in Theorem 1.1 
is Bernoulli. 

In ergodic theory, it is well known that a nondegenerate strictly sta- 
tionary, finite-state sequence with zero entropy is not Bernoulli; see e.g. [26, 
section 6.4]. It follows that the examples of Flaminio [16] alluded to above 
are not Bernoulli. Consequently, even if those examples of Flaminio turn out 
to be counterexamples to the CLT (apparently still an open question). Theo- 
rem 1.1 (with Remark 1.2) still gives new information (beyond the examples 
given by Flaminio [16] and by the author and Pruss [6]) in that it provides a 
5-tuplewise independent counterexample which has the additional property 
of being Bernoulli. 

Two strong mixing conditions. Next, we would like to use Theorem 1.1 
to obtain some perspective on a classic CLT (stated in Theorem 1.4 below) 
involving Rosenblatt's [29] "strong mixing" condition. This will require some 
more definitions and background information. 

Again suppose X := {Xf.,k e Z) is a strictly stationary sequence of 
(real-valued, not necessarily finite-state) random variables on a probability 
space (O, JF, P). 

For any two d-fields A and B G J-', define the measures of dependence 

a{A,B):= sup \P{AnB) - P{A)P{B)\ and 

I J 

(3iA, B) sup (1/2) E ^^o)- nAi)nB,)\ 

where the latter supremum is taken over all pairs of finite partitions {^i, . . . , 
Ai} and {Bi, . . . , Bj} of Q, such that Ai e A for each i and Bj e B for each 
j. (The factor of 1/2 in the definition of (3{A,B) is of no significance, but 
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has become standard in the hterature.) For each positive integer n, define 
the dependence coeflBcients 

a{n) := a{X,n) :— a{T^^^T^) and 

(3{n) :=P{X,n) := P{J^^,T^). 

By strict stationarity, ct(-^-oo5 -^j+n) ~ (x{n) and (^{^-ooi ^j+n) ~ /^('^) 
every integer j. The (strictly stationary) sequence X is said to satisfy the 
Rosenblatt [29] "strong mixing" condition, or "a-mixing," if a{n) — > as 
n — > oo; and it is said to satisfy the "absolute regularity" [33] condition if 
/3{n) — as n ^ oo. For the first of those conditions, the term "a-mixing" 
will be used here in order to avoid ambiguity from conflicting uses of the 
phrase "strong mixing" in the literature. 

Obviously absolute regularity implies a-mixing. For strictly stationary, 
finite-state sequences, one also has the following: 

(i) First, a-mixing does not imply absolute regularity (see e.g. [5, Vol. 
1, Theorem 9.10(11)]). 

(ii) The "weak Bernoulli" condition, defined and studied by Friedman 
and Ornstein [17], is equivalent to absolute regularity, and (as was shown in 
that paper) it implies the Bernoulli property. 

(iii) It is unknown (an open problem posed by Donald Ornstein in the 
1970s) whether a-mixing implies the Bernoulli property. 

(iv) The Bernoulli property does not imply a-mixing (and hence also 
does not imply absolute regularity); that was shown by Smorodinsky [32]. 

The strictly stationary, 3-state, triplewise independent, absolutely reg- 
ular counterexample (to the CLT) developed in [3,4], alluded to above, is in 
two respects "optimal" under absolute regularity: First, with its random vari- 
ables being bounded (in fact, finite-state), its "mixing rate" (3{n) = 0{l/n) 
(as n — > oo) is essentially as rapid as possible (it cannot satisfy /3(n) = o{l/n) 
or even a{n) = o(l/n), by a CLT of Merlevede and Peligrad [21]). Second, as 
was pointed out in [4, section 1] with a brief explanation, if a given strictly 
stationary sequence of nondegenerate, square-integrable random variables 
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satisfies both a-mixing (or absolute regularity) and 4-tuplewise indepen- 
dence, then it satisfies the CLT. (This fact is an elementary corollary, via 
a truncation argument, of the CLT under a-mixing given in Theorem 1.4 
below.) As a consequence: 

Remark 1.3. The random sequence X in Theorem 1.1 cannot satisfy 
Qj-mixing (or absolute regularity). 

In the latter part of the book [5, Vol. 3], there is a detailed presentation 
of a large collection of strictly stationary, absolutely regular (but in most 
cases not pairwise independent or finite-state) counterexamples to the CLT, 
including examples of Davydov [11], and also including a (slightly embel- 
lished) presentation of the well known example of Herrndorf [18] in which 
the random variables are uncorrelated. 

The double tail a-field. Let us digress to take a quick look at some of 
the ways property (D) in Theorem 1.1 fits in with the various dependence 
conditions above, for strictly stationary sequences. 

(i) First, it is well known and elementary (see e.g. [5, Vol. 1, Proposition 
5.17]) that absolute regularity implies a trivial double tail u-field. 

(ii) Next, a-mixing does not imply a trivial double tail cr-field. See for ex- 
ample the counterexample in [2] or [5, Vol. 2, Theorem 24.14] with real state 
space, or the finite-state counterexample constructed by Burton, Denker and 
Smorodinsky [8] . Each of those examples is "bilaterally deterministic" (that 
is, the entire random sequence is, modulo null-sets, measurable with respect 
to its double tail cr-field). 

(iii) In the finite-state case, the Bernoulli property does not imply a triv- 
ial double tail cx-field. Ornstein and Weiss [25] showed instead that within the 
class of strictly stationary, finite-state random sequences that are Bernoulli, 
the ones that are also bilaterally deterministic are in a certain sense "ubiq- 
uitous." 

(iv) In the finite-state trivial double tail cr-field does not imply 
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CK-mixing (see e.g. [5, Vol. 1, Theorem 9.11(11)]), and hence also does not 
imply absolute regularity. 

A classic CLT under a-mixing. Now let us take a quick look at the 
following classic theorem: 

Theorem 1.4. Suppose X := [X^^k e Z) zs a strictly stationary se- 
quence of (real-valued) random variables such that EXq = 0, EXq < oo, 
:= ES^ — > oo as n ^ oo, and a{n) as n ^ oo. Then the following 
two conditions (I), (II) are equivalent: 

(I) The family of random variables {S^/a^, n e N) is uniformly inte- 
grable. 

(II) Sn/cTn ^ N{0, 1) as oo. 

Even if the assumption of a-mixing were omitted altogether, (II) implies 
(I), by a well known, elementary argument (see e.g. [13] or [22] or [5, Vol. 1, 
top half of p. 38]). The interest here in Theorem 1.4 is the fact that under all 
of the given assumptions, (I) implies (II). That fact was shown by Cogburn 
[9, Theorem 13] (with a-mixing replaced by a similar but technically weaker 
condition), a reference that did not seem to be well known for a long time; 
and its proof was also given by Denker [13] and by Mori and Yoshihara 
[22]. (A proof of Theorem 1.4 is spelled out in generous detail in [5, Vol. 1, 
Theorem 1.19].) 

By properties (A), (B), and (E) in Theorem 1.1, the sequence X in 
Theorem 1.1 satisfies EXq = 0, EXq < oo, := ES^ = n for n e N, as 
well as the uniform integrability of {S^/n, n e N). Hence by properties (A), 
(C), (D), and (F) in Theorem 1.1, together with Remark 1.2, one has the 
following: 

Remark 1.5. In Theorem 1.4 (for the assertion that (I) implies (II)), 
even if the random variables X}~ are finite-state and 5-tuplewise independent, 
the assumption of a-mixing cannot be replaced by either (or both) of the 
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assumptions that 

(i) X is Bernoulli (or even that Property (C) in Theorem 1.1 holds), 

(ii) X has a trivial double tail cr-field. 

Suppose the hypothesis of Theorem 1.4 holds, along with the extra as- 
sumptions that (i) o"^ = n-h{n) where h : (0, oo) — > (0, oo) is slowly varying at 
cx), and (ii) limsup^^^ ||^n||2/[(7r/2)i/2£;|^^| ] < 1. Then the CLT (specif- 
ically, conclusion (II) of Theorem 1.4) holds. That is a result of Dehling, 
Denker, and Philipp [12, Theorem 4]. (For an exposition of their argument 
in generous detail, see [5, Vol. 2, Theorem 17.11].) It seems to be an open 
question whether that still holds if the assumption of a-mixing is replaced by 
(say) properties (B), (C), and (D) in Theorem 1.1. Because of the absolute- 
value signs, the quantities seem to be hard to estimate effectively for 
the construction given below for Theorem 1.1. 

The rest of this paper is devoted to the proof of Theorem 1.1. Here is 
how that proof will be organized, in Sections 2 through 10: 
§2. Some basic notations 

§3. Some special probability measures on {—1, 1}"^ with m being powers of 6 
§4. A particular class of functions on certain infinite sequences of vectors 
§5. A special Markov chain (based on Section 4) and a related random 
sequence 

§6. Scaffolding: primarily a random field {wl^\ n G N, k E Z) based on 
Section 5 

§7. More scaffolding: including the random sequence X for Theorem 1.1 
§8. More scaffolding: random sequences {Xl''\k e Z) and {Y^''\k e Z) for 
n e N 

§9. The proofs of most properties in Theorem 1.1 
§10. Proof of property (D) in Theorem 1.1 
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2. Notations and conventions 



This section gives some specific notations and conventions that will be 
used throughout this paper. 

The cardinality of a set S will be denoted card S. 

For a given probability space (O, J-", P), the indicator function (on O) of 
a given event A will be denoted I{A), and the cr-field (c J-) generated by 
a given collection (Vj, j e J) of random variables (where J is an index set) 
will be denoted cr(V}, j E J). 

A "left-infinite sequence" (of elements of some set) is a family of elements 
{xk, k < j) where j is an integer (and k is restricted to integers). Often j — 
in that context. 

Notations 2.1. (A) For typographical convenience, for a given nonneg- 
ative integer n, whenever the integer 6"^ appears in a subscript or superscript, 
we shall use the notation 

(2.1) sxtp(n) := 6". 

(The letters "sxtp" are an abbreviation of the word "sextuple." ) 

(B) For a given n e N and a given vector a := (ai, a2, . . . , a„) e R", 
the sum and product of the elements will be denoted by 

n n 

(2.2) sum(a) := ^^Ofe and prod(a) := JJ^ a^. 

fc=l k=l 

(C) Suppose m e N, and for each u e {1,2, ...,6}, '■= {vu,i,Vu,2, 
■ • ■ 1 Vu,m) is a vector with m coordinates. Then the notation {vi,V2, ^3, ^4, v^, 
ve) will mean the vector w := (wi, W2, ■ ■ ■ , wem) with 6m coordinates such 
that for each u E {1, 2, . . . , 6} and each j G {1, 2, . . . , m}, W(u-i)m+j = '^u,j- 
That is, in the vector {vi, V2, vs, v^, fs, vq), with 6m coordinates, the first m 
coordinates are (in order) the coordinates of vi, the next m coordinates are 
those of V2, and so on, with the last m coordinates being those of vq. 

(D) On the family of all nonempty finite subsets of Z, the following 
partial ordering will be used: For such sets A and B, the notation A < B 
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(or B > A) means that max^ < minS (equivalently, a < 6 for all a & A, 
beB). 

(E) Suppose 5" is a nonempty finite set of integers. If (afc, /c G 5") is a 
family of elements of some set A, then the notation as denotes the vector 
defined by 

(2-3) as := (0^(1), 0^(2), • • • , ag^n)) 

where n = card S and < s(2) < ... < s{n) are in increasing order the 
elements of S. Similarly, if {Xk, k E S) is a family of random variables on a 
probability space (fi, J-', P), then the notation Xs denotes the random vector 
defined by 

(2-4) Xs := {Xs(i), Xg(^2), • • • , Xgf^n)) 

where the s(j)'s are as above. The vector as in (2.3) and the random vector 
Xs in (2.4) will also be expressed respectively as (as(j), 1 < i < n) and 
(^s(i), l<i<n). 

(F) (i) A set 5 C Z is said to be "doubly infinite" if it contains infinitely 
many negative integers and infinitely many positive integers. 

(ii) If {ak, e Z) is a ("two-sided") sequence of elements of some set A, 
and is a doubly infinite subset of Z, then the notation {aj, j G S) refers 
to the sequence (as(^), £ G Z) where 

. . . < s(-2) < s(-l) < s(0) < < 1 < s(l) < s(2) < s(3) < . . . 

and>S = {...,s(-l),s(0),s(l),...}. 

(G) If (ofe, G Z) is a ("two-sided") sequence of elements of some set 
A, and is a subset of Z which is both infinite and bounded above, then 
a convention "opposite" to that of sections (E) and (F) will be used: The 
notation {aj, j G S) refers to the sequence (as(o)) as(_2), . . . ) where 
s(0) > s(-l) > s(-2) > ... and 5' = {s(0),s(-l),s(-2),...}. 

(H) Suppose £ = {El, E^, . . .} is a nonempty family of finitely many 
or countably many sets Ei G Z. (The sets Ei themselves can be countable 
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or finite, or even empty, and they need not be disjoint.) Then define the 
notation 

union £ -.^ Ei U E2 U E3 U . . . , 
the union of all sets e £. 

Definition 2.2. (A) For each n e {0, 1, 2, . . . }, we shall define a func- 
tion V'n : {0, 1, 2, 3, 4, 5, 6}^ — > {0, 1,2,...}. Suppose a := (oo, ai, 02, . . . ) 
is a sequence of elements of {0, 1, . . . , 6}. If the set {/c > : afc = 1} is infi- 
nite, then define the nonnegative integers i^oi^^): '4^2ifl)i ■ ■ ■ (uniquely) 
by the conditions 

< V'o(a) < V'i(^) < V'2(a) < ... and 

{A; > : Ofe = 1} = {V'o(a), V'i(a), ^^2(0), • • •}• 

If instead the set {A; > : afc = 1} is finite, then V'n(a) := for all n > 0. 
(This last sentence will be an irrelevant formality.) 

(B) Remark. In that definition (both cases), if ao = 1 then ^'0(0) = 0. 

Definition 2.3. (A) A ("two-sided") sequence w := (tufe, A; e Z) of 
elements of {0,1,2,3,4,5,6} satisfies "Condition <S" if the following three 
statements hold: 

(i) For each i e {1,2,3,4,5,6} the set {A; e Z : Wfe = i} is doubly 
infinite. (That is not required for i = 0.) 

(ii) For each i e {1,2,3,4,5} and each £ e Z such that W£ = i, either 
(a) we+i = z -|- 1 or (b) for some m > 2, one has that wg+i = W£+2 = ■ ■ ■ = 
W£+„i-i = and wi+^ =i + 1. 

(iii) For each £ G Z such that W£ — 6, either (a) = 1 or (b) for 
some m > 2, one has that we+i = we+2 = ■ ■ ■ = we+m-i = and wg+rn = 1- 

That is, the sequence w satisfies Condition S if "from time immemorial," 
the non-zero elements in w cycle through 1, 2, . . . , 6 in order, over and over 
again, with perhaps some O's in between. 
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(B) Remark. Suppose w := {wk, A; e Z) is a sequence of elements of 
{0, 1, . . . , 6} that satisfies Condition S. Then for any two integers J and L 
such that J < L, one has that 



(2.5) 



card{/c E Z : J < k < L and Wk = 1} 



< 1 + (1/6) • card{/c e Z : J < k < L and Wkj^O}. 



The point is that between any two "consecutive I's," there are (exactly) five 
non-zero elements (2,3,4,5,6, each once). Hence, if the left side of (2.5) 
equals £ for some £ > 2, then the set in the right side of (2.5) has at least 
£ + 5{i — 1) elements, and thus (2.5) holds. Equation (2.5) holds trivially 
when its left side is or 1. 

(C) Remark. Suppose S := { . . . , s(— 1), s(0), s(l), . . .} is a doubly in- 
finite set of integers where ... < s( — 1) < s(0) < s(l) < ... . Suppose 
w :— [wk, G Z) is a ("two-sided") sequence of elements of {0,1,..., 6} 
such that (i) = for all /c e Z — 5, and (ii) the ("two-sided") sequence 
( . . . , Ws(-i),Wg(^Q),Wg(^i), . . . ) satisfies Condition S. Then the entire sequence 
w satisfies Condition S. 

(In words, if a given two-sided sequence satisfies Condition S, and one 
sticks some zeros between its entries, the resulting new sequence still satisfies 
Condition S.) 

Notations 2.4. (A) The 6x6 identity matrix will be denoted Iq. 

(B) The transpose of a vector v will be denoted f 

(C) The elements of {0, 1}^ will be represented as "row" vectors. Sup- 
pose m is a positive integer, and for each i e {1,2,..., m}, ctj := (an, ai2, 
. . . , aie) is an element of {0, 1}^. Then for the 6 x m matrix whose columns 
are the transposes of the a^'s respectively, we shall use the following notation: 



On "21 



(2.6) 




Oll2 CX22 



am2 



Q^m6 - 
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(D) A ("left-infinite") sequence iPo,P-i, (3-2, ■ ■ ■) oi elements of {0, 1}^ 
is said to be "back-standard" if 

(2.7) [/?|_5 I /3t4 I • • • I fi'e\ = h 

holds for infinitely many integers £ < 0. A ("two-sided") sequence {(3k, 
G Z) of elements of {0, 1}^ is said to be "two-sided standard" if the set 
e Z : (2.7) holds} is doubly infinite (see Section 2.1(F)). 

(E) In the proofs of lemmas, we shall often use the notation 

(2.8) /?j :=(/?,•, /3,-+i,...,/3,) 

when j <l are integers and (3^ G {0, 1}^ for each /c e {j, . . . , £}, and also the 
("reverse") notation 

(2.9) :=(/?,,/?,_!, /5,_2,...) 

when £ e Z and e {0, 1}^ for each k < £. 

Notations 2.5. (A) Suppose that on a probability space (O, J^,P),r] is 
a random variable (or random vector, etc.) taking its values in a measurable 
space {A, A). The distribution (or "law") of r] (on {A, A)) will be denoted 
C{r]). For any event F such that P{F) > 0, the conditional distribution of r] 
given F will be denoted C{r] \ F). 

(B) Suppose m is a positive integer and A is a probability measure on 
{-1,1}"^. Then At^l will denote the six-fold "product measure" of A. That is, 
A'^1 is the distribution (on {—1, l}^"*) of a {—1, l}^"^-valued random vector 

(Zi, Z2, . . . , Zq) 

(in Notation 2.1(C)) where Zi, Z2, ■ ■ ■ ■, Zq are six independent {—1,1}"*- 
valued random vectors, each having distribution A. 

(C) Suppose (il, J^, P) is a probability space. For two events A and 
S, the notation A = B will mean that P{A/\B) = 0, where A denotes the 
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symmetric difference. If A is an event and B is a cr-field C J^, then the 
notation AeB will mean that there exists an event B e B such that A=B. 
If A and B are a-fields C JF, the notation A<zB will mean that for every 
Ae A, one has that AeB. 

In arguments below, we shall sometimes simply show A<zB with a quick 
verification, in place of ^ C -B, when that latter literal inclusion is not needed 
and requires a longer argument. 

Definition 2.6. (A) Suppose that on a probability space P), 
Y :— (Yfc, /c G Z) is a sequence of random variables taking their values in 
a measurable space {A, A) and Z := (Z^, /c e Z) is a sequence of random 
variables taking their values in a measurable space {B, B). The ordered pair 
(y, Z) is said to satisfy "Condition A4" if the following two conditions are 
satisfied: 

(i) The sequence Z is strictly stationary. 

(ii) There exists a measurable function / : B^ A (that is, f~^{H) e 
B^ for every H e A, for the "infinite product" (7-field B^ := BxBxBx . . .) 
such that for each k E Z, Yk = /{Zk, Zk-i, Zk-2, • • • ) a-s. 

(B) Remark. Obviously, if (Y, Z) satisfies Condition M., then (i) the 
sequence Y is strictly stationary, and (ii) cr(Y) Ca{Z) (see section 2.5(C)). 

Notations 2.7. Suppose (0,:F, P) is a probability space. 

(A) An ordered triplet {A, B, C) of cr-fields C is a "Markov triplet" if 
one has that for A e A and aU C e C, P{A n C\B) = P{A\B) ■ P{C\B) 
a.s. 

A "restricted" version of (A) will also be needed for some random se- 
quences that are not Markov chains but have some "limited" Markov prop- 
erties: 

(B) Suppose B e J^, and suppose A and C are u-fields C The ordered 
triplet {A, B, C) is a "restricted Markov triplet" if (i) P{B) > 0, and (u) for 
allAeA and aU C eC, P{A n C\B) = P{A\B) ■ P{C\B). 
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(C) Remark. If {A,B,C) is a restricted Markov triplet, A e A, P{A O 
B) > 0, and C eC, then (by a trivial calculation) P{C\A n B) = P{C\B). 

(D) Remark. Suppose Q and Ti. are independent a-fields C JF. Suppose 
G E and Qi and Q2 are cr-fields C ^, and {Qi, (7, ^2) is a restricted Markov 
triplet. Suppose H e H, and Tii and 7^2 are cr-fields C Ti, and {Hi, H,H2) 
is a restricted Markov triplet. Then (^1 VTii, GdH, ^2 V7i2) is a restricted 
Markov triplet. 

Proof of (D). Of course P{G f] H) = P{G) ■ P{H) > 0. By a simple 
calculation, if G\ G ^1, G2 £ ^2, H\ eHi, and i?2 € "^2, then 

P{Gi nG2nHinH2\GnH) = P{Gi n G2 1 G) • p{Hi nH2\H) 
= P{Gi\G) ■ P{G2\G) ■ P{Hi\H) ■ P{H2\H) 

= P{Gi \GnH)- P{G2 \ GnH)- P{Hi \ G n H) ■ P{H2 \GnH). 

Thus under the probability measure Q{.) := P{.\G (1 H) on {VL,T), the 
four cr-fields Qi, Q2, Ti-i, and 7^2 are independent, and hence (under Q) the 
cr-fields Qi V Hi and Q2 V H2 are independent. Thus (D) holds. 

Remark 2.8 (a standard trivial but useful fact). Suppose (O, J^, P) is 
a probability space, C = [J-Ci where Ci, C2, C3, . . . is a finite or countable 
sequence of (pairwise) disjoint events, P{Ci) > for at least one i, D is an 
event, p e [0, 1], and P{D\Ci) = p (resp. > p resp. < p) for every i such that 
P{Ci) > 0. Then P{D\C) = p (resp. > p resp. < p). 

3. Some key probability measures 

This section is devoted to the definitions and key properties of certain 
discrete probability measures that will play a pervasive role in the construc- 
tion for Theorem 1.1. 

In connection with the design of error-correcting codes, the book by 
McWilliams and Sloane [20] includes an extensive treatment of construc- 
tions, for a given positive integer k, of "big" /c-tuple wise independent random 
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vectors from "small" ones. The material here in section 3 fits into that gen- 
eral framework (in a somewhat hidden way). However, the details will need 
to be spelled out here, in order to facilitate the proofs of certain properties 
(in particular, the bounds on sixth moments of partial sums) in Theorem 1.1. 

The main tool in this section is a well known, elementary "parity" trick, 
built into Definitions 3.1 and 3.3 below. The same general type of "parity" 
trick was used (with different distributions) by Pruss [28] and by the author 
and Pruss [6] in the constructions in those papers, and was also used (for 
different purposes) in the book [20] alluded to above. 

In this section, for convenience, for a given n e N and a given element 
X e {—1, l}sxtp(n) ^ggg (2.1)), X will be represented as (xq, a;i, . . . , a;gxtp(n)-i) 
(instead oixi,X2,..., a;gxtp(n)))- 

Definition 3.1. Referring to (2.2), define the set 

T := {x := {xo, xi, . . . , x^) e {-1, 1}^ : prod(a;) = -1}. 

That is, T is the set of all 6-tuples of — I's and +l's with an odd number of 
— I's. For a given x := (a;o, xi, . . . , x^) e T, sum(a;) (see (2.2)) is —4 (resp. 
resp. 4) if exactly 5 (resp. 3 resp. 1) of the a^j's are —1. 

Let u^^^ denote the uniform probability measure on T. That is, 
u^''y{{x}) = 1/32 for each xeT. 

Remark 3.2. If V := {Vq,Vi, . . . ,¥5) is a {-1, 1} ^-valued random 
vector with distribution u^^^ (thus V E T a.s.), then by trivial arguments, 
the following statements hold: 

(A) The distribution of the random vector is z/^^^. 

(B) For any permutation a of {0, 1, . . . , 5}, the distribution of the ran- 
dom vector (V^(o), V^(i), • • • , ^"^(5)) is i^^""^- 

(C) For each z e {0, 1, . . . , 5}, P(Vi = -1) = P{Vi = 1) = 1/2. 

(D) For every set S C {0, 1, . . . , 5} such that card 5 = 5, the random 
variables Vi, i E S are independent. 
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(E) prod(y) = -1 a.s. (see (2.2)). 

(F) P(sum(T/) = 0) = 5/8 and P(sum(y) = -4) = P(sum(F) = 4) = 
3/16 (see (2.2)). 

(G) For each i G {0, 1, . . . , 5}, P{Vi = l|sum(y) = 4) = 5/6 and P{Vi = 
-l|sum(y) = 4) = 1/6, and hence E{Vi\svLm{V) = 4) = 2/3. 

Definition 3.3. Refer to (2.1) and (2.2). For each n G N, we shaU de- 
fine four probabihty measures i'^^, I'cen, i^i^i , and i^pos on the set 
{-1, l}sxtp(n)^ g^^Yi that the following holds: 

If W := {Wo, W^,..., W^sxtp(n)-i) is a {-1, l}«-tp(-)-valued 

(3.1) 

random vector with distribution z^pos, then sum(VF) = 4" a.s. 

(The subscripts "ord" , "cen," "fri," and "pos" are respectively abbreviations 
of the words "ordinary" "center," "fringe," and "positive." The relevance of 
those subscripts will become clear below.) For n = 0, we shall also define 
two probability measures v^^^ and i/pJa on the set {—1, 1}, such that (3.1) 
holds for n = 0. The definition is recursive and is as follows: 

Start with n = 0. On the set {—1,1}, define the probability measures 
and by = = V2 and 4ok{l}) = 1- Trivially 

(3.1) holds for n = 0. 

(n) 

Now suppose n > 0, and suppose the probability measure i^pos on 
{-1,1}^^*P(") has already been defined such that (3.1) holds. Let W^^^ := 

{wli'\wi'\...,W^Xin)-i)^ i e {0,1,..., 5} be six independent 
{ — 1, l}®^*P*^"^-valued random vectors, each having distribution z/poL Let 
V '■— (Vb, ^1, . . . , V5) be a {—1, 1} ^-valued random vector which is indepen- 
dent of the family (1^*^*^ < z < 5) and has distribution i/^^^ (see Defini- 
tion 3.1). Let Z := {Zq, Zi, . . . , ^sxtp(n+i)-i) be the {-1, l}^^^P("+i)-valued 
random vector defined as follows: 

VzG{0,l,...,5}, VjG{0,l,...,6--l}, 

(3.2) _ 
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Then (see (2.2), (3.1), and (3.2)) with probabihty 1, 

5 sxtp(n) — 1 

(3.3) sum(Z) = J2 ^^"^f = (sum(F)) • 4", 

and hence (see Remark 3.2(F)) sum(Z') takes the value resp. — 4"'"'"^ resp. 
4"+^ with probability 5/8 resp. 3/16 resp. 3/16. 

Let t'ord^^'' denote the distribution on {—1, ij.sxtp(n+i) q£ ^j^g random vec- 
tor Z. Let i^cen^^"* resp. I'f^j^^^ resp. I'pos^''^'' denote the conditional distribution 
on |— l}.sxtp(n-i-i) q£ ^j^g random vector Z given the event {sum(Z) = 0} 
resp. {|sum(Z)| = 4"+^} resp. {sum(Z) = 4"+^}. Thus (3.1) holds with n 
replaced by n + 1. This completes the recursive definition. 

Remark 3.4. For each n e N, = {5/8)i^tl + (3/8)4?- 

Proof. If Z is a {—1, 1}^^^^*^"-* -valued random vector with distribution 
^OTd' ^ l}®^*^'^"^ then (see the comments after (3.3), but with 

n + 1 replaced by n) 

^i:liB) ^ P{Z e B) 

= P{Z e S|sum(Z) = 0) • P(sum(Z) = 0) 

+ PiZ e B\ |sum(Z)| = 4") • P(|sum(Z)| = 4^) 

The various distributions in Definition 3.3 have pervasive symmetries. 

We will need later on, and will verify in the next two sections, only a couple 
of mild aspects or manifestations of those symmetries. 

Remark 3.5. (A) For a given n > 0, if the random vectors W'^'^\ 
i G {0,1,..., 5}, V, and Z arc as in Definition 3.3, then the distribution 
of the random collection {VjW^'^\W^^\ . . . ,W^^'^) is (by independence) a 
product measure on {-1, 1}^ x ({-1, i}sxtp(n)-)6^ ^^^^ (-^y Remark (3.2)(A)) 
is the same as that of {-V,W^°\w'^^\ . . . ,W^^^), and hence by (3.2) the 
distribution on {—1, l].sxtp(n+i) ^j^g random vector —Z is the same as that 
of Z. 
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(B) By an elementary argument, it follows that for any given n e N, the 
distributions z/^^^, feel, and ly^^^ on { — 1, i}sxtp(n) satisfy the symmetry con- 
ditions iyi:l{{-x}) = i^i^liix}), ui^l{{-x}) = ui:l{{x}), and = 
^fri^({'^})- n = 0, this holds trivially for i^^^^ ■ 

(C) Here for convenient reference are a few other features and ele- 
mentary consequences of Definition 3.3, for a given n > and a given 
X e {-l,l}«^tp("): (i) If sum(a;) = 4" then 4^\{-x}) = iyl^\{x}) = 
{l/2)4Zl{{x}). (ii) If 4os({^}) > then sum(x) = 4". (iii) If iyi^\{x}) > 
then sum(a:) = —4"" or 4"". (iv) If (n > 1 and) Uceniix}) > then sum(a;) = 0. 
(v) If (n > 1 and) i^i^^lUx}) > then sum(a;) = -4^, 0, or 4". 

Lemma 3.6. Suppose n > 0. Suppose Y := (I05 • • • 5 ^sxtp(n)-i) 
is a { — IjlY^^^^"^^ -valued random vector whose distribution is z^pos- Then 
EYk = (2/3)" for every /c e {0, 1, . . . , 6" - 1}. 

Proof. Lemma 3.6 holds trivially for n = 0. Now for induction, sup- 
pose it holds for a given n >0. Let the random vectors W^'^\ i G {0, 1, ... , 5}, 
V, and Z be as in Definition 3.3. By (3.3), the events {sum(Z) = 4"+^} and 
{sum(y) = 4} are identical (modulo a null set). By (3.2), Remark 3.2(G), 
and our induction hypothesis, for each i e {0,1,..., 5} and each 
JG{0,1,...,6--1}, 

^(^i.sxtp(n)+,- I sum(Z) = 4-+1) =E(Vi- W^f ^ I sum(V^) = 4) 
= EW^'^ ■ E{Vi\sum{V) = 4) = (2/3)^ • (2/3) = (2/3)^+^ 

Thatis, £;(Zfe|sum(Z) = 4"+^) = (2/3)"+^ for every /c e {0, 1, . . . , 6"+^ - 1}. 
By Definition 3.3 itself. Lemma 3.6 holds for n -|- 1. That completes the 
induction step and the proof. 

Lemma 3.7. Suppose n > 0. Suppose Y := (Yq, Yi, . . . , Kixtp(n+i)-i) is 
a {—1, ly^^'^^^'^^^ -valued random vector with distribution (^'f^'i'')'^^ (see sec- 
tion 2.5(B)). Suppose Z := (Zq, Z^, . . . , Z,,tp(n+i)-i) is a {-1, l}sxtp(n+i)_ 
valued random vector with the distribution i^^^^^ ■ Then the following three 
statements hold: 
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(A) For every set S G {0,1,.. . ,6^+^ - 1} such that card S = 5, the 
random vectorsYs and Zs (see (2.4)) have the same distribution on {—1, 1}^. 

(B) For every nonempty set Q C. {0, 1, ... , Q'^^^ — 1}, one has that 

(3.4) ^(E^O ^^(E^O • 

(C) Also, 

(3.5) £;(sum(r))6 = E{sma{Z)f + 720 ■ 4^". 

Proof. Suppose n > 0. Without loss of generality, to prove Lemma 3.7, 
we shall construct particular convenient random vectors Y and Z with the 
required distributions, and then prove statements (A), (B), and (C) for those 
two random vectors. 

Let the random vectors W^'^\ z e {0, 1, . . . , 5}, V, and Z be as in Defini- 
tion 3.3. In that context, let Ui, i G {0, 1, . . . , 5} be independent, identically 
distributed {—1, l}-valued random variables with P{Ui = —1) = P{Ui = 
1) = 1/2, with the family [Ui, < i < 5) being independent of the family 
{V; W^^, < z < 5). Define the {-1, l}^^*P("+i)-valued random vector 
Y := {Yo,Yi, . . . ,ysxtp(n+i)-i) as follows: 

(3.6) Vze{0,l,...,5}, Vje{0,l,...,6"-1}, 

By Remark 3.5(B)(C), Definition 3.3, and a simple argument, for each 
i G {0,1,..., 5}, the distribution on {— 1, l]-'^^tp("^) of the random vector 
{Ui ■ W^'\ < j < 6" - 1) (see the sentence after (2.4)) is u^^\ Prom 
this and the definition of Definition 3.3, the random vectors Y 

and Z constructed here have the distributions specified in the statement of 
Lemma 3.7. 

Just for this proof, define for each i G {0, 1, . . . , 5} the set 

(3.7) K, = kI""^ {/c G Z : i ■ 6" < A; < (z + 1) ■ 6" - 1}. 
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These sets Kq, Ki, . . .^K^ form a partition of the set {0, 1, ... , 6"'"'"^ — 1}. 
As a consequence of Remark 3.2(C) (D) and the above conditions, for any- 
set A C {0, 1, . . . , 5} with card A = 5, the random family {Vi, i G A; W^'^\ 
i e A) has the same distribution — a ten- fold product measure on { — 1, 1}^ x 
({-1, i}sxtp(n)-)5 — ^ ^Yie random family (C/j, i e A; W^^\ i e A). Hence by 
(3.2) and (3.6), for every set A C {0, 1, . . . , 5} with card A = 5 (see section 
2.5(A) and the sentence after (2.4)), 

(3.8) cfYk, ke[jK,^= c(zk, ke[jK,^ 

(an equality of distributions on {-1, i}5 sxtp(n)^ 

Now if S C {0, l,...,6"+i - 1} is such that card 5 = 5, then S C 
(J^^y^ Ki for some set A C {0, 1, . . . , 5} with card A < 5. Hence statement 
(A) in Lemma 3.7 follows from (3.8). 

Proof of statements (B) and ( C). For any nonempty set Q C {0, 1, . . ., 
6^+1 - 1}, 

(3.9) ^(j^n) -e{Y,Z^ 



•k€Q 



fc(0)eQfe(l)€Q fc(5)6Q 



i=0 / \i=0 



For any set A C {0, 1, . . . , 5} with card A = 5, and any choice of (not 
necessarily distinct) elements k{0), A;(l), . . ., k{5) of \J-^j^Ki, the term in 
the brackets in (3.9) equals by (3.8). On the other hand, if k{i) e Ki for 
every i G {0, 1, ... , 5}, then representing k{i) — i ■ 6"^ + where G 
{0, 1, . . . , 6"^ — 1}, one has 



k(i) 



.1=0 



Wew^ 



(i) 



i=0 



= 



by (3.6) and the trivial fact EUi = 0, and one also has 



.i=0 
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= -1 • [(2/3)1^ = -(2/3) 



\6n 



by (3.2), Remark 3.2(E), and Lemma 3.6. Hence by (3.9) for any nonempty 
set Q C {0,l,...,6"+i - 1}, 

5 

(3.10) [Left side of (3.9)] = (2/3)^^ • 6! • JJ card(Q n Ki). 

1=0 

Statement (B) in Lemma 3.7 follows. Since card Ki = 6"^ for each i, state- 
ment (C) follows from (3.10) with Q = {0, 1, . . . , 6"+^ - 1} itself. That 
completes the proof. 

4. Some particular functions 

A key "building block" in the construction of the random sequence X in 
Theorem 1.1 will be a particular strictly stationary, finite-state, irreducible, 
aperiodic Markov chain. It will be given a particular, explicit representation 
as a "causal moving function" (a la eq. (1.3)) of an i.i.d. finite-state sequence. 
This representation will be spelled out in detail in Section 4 here and Sec- 
tion 5 together (the Markov chain itself will be identified in Lemma 5.3), in 
order to facilitate transparent proofs (in Sections 7 and 10 respectively) of 
property (C) and (especially) property (D) in Theorem 1.1. The particular 
form of the representation that will be used here is an old one that goes back 
several decades; its origin is hard to trace. Its spirit goes back at least to a 
paper of Rosenblatt [30] in which it is shown that every strictly stationary, 
countable-state, irreducible, aperiodic Markov chain can be represented as a 
"causal moving function" of an i.i.d. sequence. 

Definition 4.1. For each n G N, we shall define a function hn '■ 
({0, l}^)" — > {1, 2, 3, 4, 5, 6}. The definition will be recursive and is as follows: 

First, define the function hi : {0,1}^ {1,2, ...,6} as follows: For 
a := (ai, a2, . . . , ae) e {0, 1}^, 

(4.1.1) 

Now suppose n > 2, and the function hn-i : ({0, l}6)n-i ^ {1, 2, . . . , 6} 
has already been defined. Define the function hn : ({0, 1}^)" — > {1, 2, . . . , 6} 
as follows: 
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Suppose that for each i e {1,2, ...,n}, Pi := A,2, • • • , A.e) e 

{0, 1}6. If K-iiPu /^2, . . . , Pn-i) = 3 e {1, 2, 3, 4, 5}, then 



(4.1.2) 

If instead hn-i{Pi, P2, • • • , Pn-i) = 6, then 
(4.1.3) 



if/3. 







U Q /3 \ j 6 if /3n,l = 

"nlPl, P2, • • • , Pnj 1 1 if 1 = 1 



That completes the recursive definition of the functions hn- 

Lemma 4.2. Suppose £ e {~5, —6, —7, . . . }, and P^, Pe+i, . . . , are 
each an element of {0, 1}^, and that 



(4.2.1) 



[PU 1 13-4 1 /3i3 1 13-2 1 /3ii] 



1 

10 

10 

1 

1 

LO OJ 



(the first five columns of the identity matrix Iq — see Section 2.4(A)(B)(C)). 
Then 



(4.2.2) 



h-i{p£,P£+i,...,P-i) = 5. 



Proof. Consider first the case £ = -5. By (4.2.1), (4.1.1), and then 
four applications of (4.1.2), one obtains /ii(/3_5) = 1, h2{P-5, P-4) — 2, 
h3{P-5, P-4, P-s) = 3, h4{Pzl) = 4 (we start using the notations in Sec- 
tion 2.4(E)), and finally h^{pzl) = 5, which is (4.2.2). 

Now consider the case where £ < —6. We shall give the argument for 
the case where 



(4.2.3) 



h-5-eiPi, Pi+i, • • • , P-e) = 3. 



The argument is similar for the other possible values (1,2,4,5, and 6) for 
the right hand side of (4.2.3). 
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Now /?_5,4 = by (4.2.1), and hence /i_4-^(/?7^) = 3 by (4.2.3) and 
(4.1.2). Next, /3_4,4 = by (4.2.1), and hence h-s-ii/S^"^) = 3 now follows 
from (4.1.2). Similarly /3-3,4 = and hence h-2-e{/3i^) = 3. Next, (3-2,4 = 1 
by (4.2.1), and hence h-i-i{f3^^) = 4 by (4.1.2). Finally, /3_i,5 = 1, and 
hence (4.2.2) now follows from (4.1.2). That completes the proof of Lemma 
4.2. 

In Definitions 4.3 and 4.5 below, two closely related functions on 
({0, 1}^)^ will be defined. Because of the way those functions will be used, 
"left-infinite" sequences will be used in their definitions. 

Definition 4.3. Define the function i/basic({0, 1}^)^ ^ {1, 2, 3, 4, 5, 6} 
as follows: 

Suppose /?o, /?-!, /?-2, • • • each e {0, 1}^. 

If the sequence (/?o, /?_2, • • • ) is not back-standard (see Section 
2.4(A)(B)(C)(D)), then define ^7basic(/3o, A, /?-2, ...):= 6. 

Now suppose instead that the sequence (/3o, /3-2, • ■ ■ ) is back- 
standard (again see Section 2.4). Let L denote the greatest integer e {0,-1, 
-2, . . . } such that [/3i_5 I | . . . | = /g. 

(i) If L = (that is, if [PU I /5-4 I • • • \Po] = h), then define ^basic(/?o, 
/3_i,/3_2,...):= 6. 

(ii) If instead L < —1, then referring to Definition 4.1, define 

(4.3.1) ghasiciPo, P-l, P-2, ■ ■ ■) ■.= h-L{pL+l,pL+2,---,Po)- 

Lemma 4.4. Suppose (/?o, /3-2, • • • ) is a ("left-infinite") back- 
standard sequence of elements of {0, 1}^ (see Section 2.4(D)). 

(A) If 5'basic 

(/J_i, 13.2, P-3, . . . ) = i e {1, 2. 3. 4, 6}, ften 

(4.4.1) <,.<,.,c(/j„./j-i./j-.,...)={j^i 1^;::+;=?. 

(B) If instead ghasidP-i, P-2, P-s, ■■■) = &, then 

(4.4.2) ^basic(/?o, P-i, P-2, ■■■) = [l i[ Z L 
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Proof. Let L denote the greatest negative integer (the integer is 
excluded here) such that (see Section 2.4(A) (B)(C)) 

(4.4.3) [/5i-5i/5i-4i---i/5i]=/6. 

The proofs of statements (A) and (B) in Lemma 4.4 will be handled 
together, and will be divided into three cases. The notations in Section 
2.4(E) (both eqs. (2.8) and (2.9)) will be used. 

Case 1: I /^^d I • • • I /^o] = h- Then /3^,6 - for £ e {-5, -4, 

. . . , —1}, and hence by (4.4.3) (which implies (3l,q = 1) and its entire sen- 
tence, L < — 6 must hold. By Definition 4.3 and Lemma 4.2, ghasic{l3Z\o) = 
h-L-iil^LXi) = 5. Hence here in Case 1, the hypothesis of statement (A) 
(in Lemma 4.4) holds with j = 5 there, and statement (B) there is vacuous. 
Since (by the definition of /g) /9o,6 = 1? the right side of (4.4.1) equals 6. Also, 
by Definition 4.3(i), the left side of (4.4.1) equals 6. Hence (4.4.1) holds, and 
statement (A) is verified. That completes the argument for Case 1. 

Case 2: [/St^ \ P*_4 \ . . . \ Pq] Iq and L = —1 (redundant — see 

(4.4.3) ). Then by Definition 4.3(i) (see (4.1.3)), £?basic(/9lL) = 6, and hence 
the hypothesis of statement (B) (in Lemma 4.4) is satisfied, and statement 
(A) there is vacuous. By Definition 4.3(ii) and Definition 4.1, 5'basic(/3-oo) = 
hi{Po) = 6 resp. 1 if /?o,i = resp. 1. Thus (4.4.2) holds, and statement (B) 
is verified. That completes the argument for Case 2. 

Case 3: [Pl^ \ pl^ \ ■ ■ ■ \ P^] !& and L < -2. By Definition 4.3(n), 

(4.4.4) 9b^ic{PZlo) = h-L-iiPZli) 
and 

(4.4.5) ^basic(/5°oo)=^-L(/5^+l). 

If the hypothesis of statement (A) (in Lemma 4.4) holds for some j e 
{1, 2, . . ., 5}, then (for that j) h-L-i{P2+i) = 3 (4.4.4), and then 
h-LiPl^i) — j resp. J + 1 if Poj+i — resp. 1 by equation (4.1.2) in 
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Definition 4.1, and then (4.4.1) — the conclusion of statement (A) — holds 
by (4.4.5). 

If instead the hypothesis of statement (B) holds, then /i_i_i(/3^^^) = 6 
by (4.4.4), h-LiPl+i) = 6 resp. 1 if /3o,i = resp. 1 by (4.1.3) in Definition 
4.1, and then (4.4.2) — the conclusion of statement (B) — holds by (4.4.5). 
That completes the argument for Case 3, and the proof of Lemma 4.4. 

Definition 4.5. Define the function fi'spaced({0, 1}^)^ {0,1,2,3,4, 
5, 6} as follows: For any given ("left-infinite") sequence (/3o, /3-2, • • • ) of 
elements of {0, 1}^, define 

(4.5.1) 5rspaced(/3o,/3-l,/3-2, • • ■) 



(The subscript "spaced" in (4.5.1) is motivated by conclusion (A) in 
the next lemma — think of elements {1,...,6} "spaced apart" with O's in 
between.) 

Lemma 4.6. Refer to Sections 2.4(D) and 2.3(A). Suppose {(3k, k e Z) 
is a two-sided standard sequence of elements of {0, 1}^. For each k & Z, 
define the numbers 



Then (A) the sequence (wk, k & Z) satisfies condition S; and (B) one has 
that 




(4.6.1) 



'■= 9hasic{Pki Pk-l, Pk-2, • • • ) 



and (see (4-5.1)) 



(4.6.2) 




(4.6.3) 



{k & Z : Wk = 1} = {k & Z : Uk-i = 6 and Uk = 1}, 



and for each i e {2, 3, 4, 5, 6}, 



(4.6.4) 



{k E Z : Wk — i} — {k E Z : Uk-i — i — 1 and Uk — i}- 
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Proof. By (4.6.1) and Lemma 4.4(A)(B), for each A; e Z, 

(4.6.5) Uk — Uk-i = or 1 mod 6. 
Hence by (4.6.2), 

(4.6.6) {A; e Z : tufe = 6} = {fc e Z : ttfc_i = 5 and Uk = 6}. 

Also, for each £ e Z such that [/3£_5 | /?^_4 | • • • | f3(\ = le, one has that 
= 6 by (4.6.1) and Definitfon 4.3(i) and ui-i = 5 by (4.6.1), Definitfon 
4.3(ii), and Lemma 4.2. Hence (by the hypothesis of Lemma 4.6) the set in 
(4.6.6) is doubly infinite (see section 2.1(F)). Hence also the ("larger") set 
{/c e Z : ttfe-i Uk} is doubly infinite. 

Now suppose A; e Z is such that Wk = 6. Then tt^ = 6 by (4.6.6). Now 
by (4.6.5), either tt^+i = 1 or there exists m > 2 such that {uk-\-iiUk+2i 
...,Uk+m) — (6, 6, . . . , 6, 1). Hence by (4.6.2), either Wk+i = 1 or there 
exists m > 2 such that (wfc+i, Wk+2: ■ • ■ , Wk+m) = (0, 0, . . . , 0, 1). 

By a similar argument, if z e {1, 2, 3, 4, 5} and /c e Z is such that Wk = i, 
then either w^+i = i + 1 or there exists m > 2 such that (wk+i, ■ ■ ■ , Wk+m) = 
(0,0,...,0,z+l). 

Since the set {k e Z : Wk = Q} in (4.6.6) is doubly infinite (as was noted 
above), it now follows (by trivial induction) that for each i G {1,2,3,4,5}, 
the set {k & Z : Wk = i} is also doubly infinite. From the preceding two 
paragraphs, we now have that the sequence {wk, k E Z) satisfies Condition S 
(again see Definition 2.3(A)). Equation (4.6.3) and (for 2 < z < 6) equation 
(4.6.4) now follow from (4.6.1), (4.6.2), and (4.6.5). Lemma 4.6 is proved. 

Lemma 4.7. For each n e N, there exist functions pn : ({0, 1}^)" — > 
{1,2,3,4,5,6} and (pn : ({0,1}^)" {0,1,2,3,4,5,6} such that following 
holds: 

For any ("left infinite") back-standard sequence {(3n, Pn-i, Pn-2, • • •) of 
elements of {0, 1}^ (see Section 2.4(D)) such that 

(4.7.1) [/3U\P-4\---\Po]-l6, 
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one has that 



(4.7.2) 




) = PniPl, P2, ■ ■ ■ , Pn) 



and 



(4.7.3) 




) =<fn{Pl,P2,---,Pn)- 



Proof. Again the notations of Section 2.4(E) will be used. 
In the arguments below, keep in mind that the equality 



(4.7.4) 



[Pl,\Pl_,\---\Pl]=It 
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cannot hold for £ e {1,2,..., 5}, for that would contradict (4.7.1). 

The first task is to define the functions pn, n e'N. 

For each n G {1,2,3,4,5}, define the function : ({0,1}^)'^ ^ {1, 2, 
... ,6} hy pn = hn from Definition 4.1. If 1 < n < 5 and (4.7.1) holds, then 
(4.7.2) holds by Definition 4.3(n). 

Now suppose instead that n > 6. Define the function p„({0, 1}^)"^ 
{1, 2, . . . , 6} as follows: Suppose /32, . . . , /9n each G {0, 1}^. Let S denote 
the set of all integers £ G {6, 7, . . . , n} such that (4.7.4) holds. If that set 
S is empty, then define Pn{Pi) '■= hn{Pi) (from Definition 4.1). If that set 
S is nonempty but does not contain n, then define Pn{Pi) '■= ^n-L(/?£+i) 
where L is the greatest element of S. If n G S, then define Pn{Pi) '■= 6. 
That completes the definition of pn. Now using Definition 4.3(i)(ii), one can 
verify, case by case, that if (4.7.1) holds then (4.7.2) holds. 

Our next task is to define the functions (pn, n & N. 

Define the function (pi : {0,1}^ — > {0,1,..., 6} as follows: For a := 
(q;i,Q!2,...,q;6) e {0,1}^, 



Now for each n > 2, define the function (p^ : ({0, 1}^)"^ {0, 1, . . . , 6} as 
follows: li (3i, (32, ■ ■ ■ , (3n each G {0, 1}^, define 



(4.7.5) 




(4.7.6) 
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That completes the definition of for n e N. 

For n > 2, if (4.7.1) holds, then (4.7.3) holds by (4.7.6), (4.7.2), and 
Definition 4.5. For n = 1, note that if (4.7.1) holds, then ghasidP-oo) = 6 
by Definition 4.3(i), (7basic(/5-oo) — 6 resp. 1 if = resp. 1 by Lemma 
4.4(B), 5rspaced(/3ioo) = I'^sp. 1 if = resp. 1 by Definition 4.5, and 
hence (4.7.3) holds by (4.7.5). That completes the proof of Lemma 4.7. 

Lemma 4.8. Suppose {j3k, k G Z) is a two-sided standard sequence of 
elements of{0, 1}^ (see Section 2.4(D)). Suppose m is a positive integer, and 
for each m e {1,2, . . .,m}, Zu := (0,0, 0,0,0,0). Then 

(4.8.1) VmG {l,...,m}, 5rspaced(^u,^it-i,---,^i,/^o,/^-i,/5-2,---) = 0; 

and 

(4.8.2) 

V n e N, ^spaced(/5n,/5n-l,---,/5l,^m,^m-l,---,^l,/5o,/5-l,/5-2,---) 
= fi'spaced(/3n5 Pn-1, ■ ■ ■ ; Pi, Poj P-lj P-2, ■ ■ ■)■ 

Proof. It suffices to prove this lemma for the case m = 1, for then the 
lemma as stated follows by induction on m. 

Accordingly, let z := zi = (0,0,0,0,0,0). Then 

(4.8.3) 5'basic(^, /5o, /^-l, /5-2, • • • ) = 5'basic(/3o, /5-2, ■ ■ ■ ) 

by Lemma 4.4 ((A) or (B), whichever applies). Hence 5'spaced(^7 /^o? /^-i: 
/?_2, . . . ) = by Definition 4.5, giving (4.8.1) (in the case u = m = 1). Our 
remaining task is to prove (4.8.2) (for m = 1). 

If ^basic(/5o, P-i, P-2, . . . ) = i e {1, 2, . . . , 5}, then by (4.8.3) and Lemma 
4.4(A), 

(4.8.4) 5'basic(/3l, Z, /3o, /3-2, . . . ) = 5'basic(/3l, Po, P-1, P-2, ■■■), 
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with the common value being j resp. j + 1 if Pij+i = resp. 1. If in- 
stead fi^basicC/^O) P-iiP-2, • • • ) = 6, then (4.8.4) holds similarly by (4.8.3) and 

Lemma 4.4(B). 

Starting with (4.8.4) and applying induction on n, using Lemma 4.4(A) (B) 
one obtains that 

(4.8.5) VneN, ghasidPn, Pn-l, ■ ■ ■ , Pi, z, po, P-i, P-2, . . .) 

= ghasiciPn, Pn-li • ■ ■ ; Pi, Po, P-1, P-2, ■ ■ ■)■ 

By (4.8.3), (4.8.5), and Definition 4.5, one has that for all n e N, (4.8.5) 
holds with the subscript "basic" replaced on both sides by "spaced." That 
is, (4.8.2) holds for m = 1. That completes the proof. 

5. A Markov chain and a related process 

This section will build on section 4, and will give a study of two particu- 
lar strictly stationary sequences — one a Markov chain, and the other closely 
related to it — that together will play a key role as a " building block" in 
the construction of the random sequence X for Theorem 1.1. 

Throughout this section, the setting is a probability space (17, .F, P), 
rich enough to accommodate all random variables defined in Construction 
5.1 below. 

Construction 5.1. (A) On the probability space (f],.F, P), let 
A; e Z, z e {1, 2, 3, 4, 5, 6}) be an array of independent, identically distributed 
{0, l}-valued random variables such that for each {k,i), 

(5.1.1) P(efe,i = 0) = 5/8 and (e^,, = 1) = 3/8. 

For each /c e Z, define the random vector 

(5-1-2) ^fc := (Cfe,l, S.k,2, ^.k,3, ^.k,4, ^k,5, Cfe,6) 

(with the above ^k/s). Then ^ := (^fc, e Z) is a sequence of independent, 
identically distributed {0, l}^-valued random vectors. 
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(For technical convenience, we assume that the random variables ^k,i 
are all defined in {0, 1} at every co & Q, not just on a set of probability 1.) 

(B) Refer to Definitions 4.3 and 4.5. Define the sequence U := {Uk, 
A; eZ) of {1,2, 3, 4, 5, 6}-valued random variables, and the sequence ofW := 
(Wfc, e Z) of {0, 1, 2, 3, 4, 5, 6}-valued random variables as follows: For each 

kez, 

(5.1.3) Uk := ghasic{Ck,Ck-i,Ck-2, ■ ■ ■) and 

(5.1.4) Wk := ^spaced (^A;,^fc-l,^A;-2,...) 

= Uk-I{Uk^Uk-i) 

where the second equality in (5.1.4) comes from (5.1.3) and Definition 4.5. 

(C) For convenient reference, here is a list (with some redundancy) of 
some basic properties of these random variables. First, 

(5.1.5) 

V /c e Z, V a; e J], Ukiu) E {1, 2, 3, 4, 5, 6} and Wkiu) e {0, 1, 2, 3, 4, 5, 6} 
by (5.1.3), (5.1.4), and Definitions 4.3 and 4.5. Next, 

(5.1.6) V /c e Z, y Loen, Uk{co) - Uk-i{co) = or 1 mod 6. 

For any a; e 1) such that the ("left-infinite") sequence {^j{uj), ^j_i(a;), 
^j_2(a;), . . . ) of elements of {0, 1}^ is back-standard (see Section 2.4(D)) for 
some (hence every) j e Z, (5.1.6) holds by (5.1.3), (5.1.5), and Lemma 4.4. 
For all other a; e il, (5.1.6) holds trivially (with Uk{oj) = 6 for all A; e Z) by 
(5.1.3) and the third paragraph of Definition 4.3. Also, referring to (5.1.5), 
one has that for each /c e Z, by (5.1.3), (5.1.4), (5.1.6), and Definition 4.5, 

(5.1.7) {Wk = 0} = {Uk = Uk-i}; 

{Wk = 1} = {Uk = 1} n {Uk-i = 6}; and 

V z e {2, 3, 4, 5, 6}, {Wk = i} = {Uk = i} n {Uk-i = i - 1}. 
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Lemma 5.2. In the context of Construction 5.1, the following statements 
hold (see Section 2.4(A) (D)): 

(A) One has that P{\iU I ^4 I ■ ■ ■ I ?o] = h) = (5/8)3° . (3/8)6. 

(B) The sequence ^ is two-sided standard a.s. 

(C) Defining the random variable 

(5.2.1) T := min {n > 6 : [^n-s I I " " " Un] = 4} 

(note that that set is a.s. nonempty, in fact infinite, by (B)), one has that 
Et<6- (8/5)30 . (8/3)6. 

(D) Suppose A is a a -field (c. T , in the underlying probability space 
{Q,T,P)) such that A is independent of the sequence ^. Suppose k := 
(. . . , k( — 1), k(0), k(1), . . . ) is a random, A-measurable, strictly increasing 
sequence of integers. Then (i) ^ := (^j, j G Z) := (Cnij), j & Ti) is a sequence 
of independent, identically distributed {0, 1}^ -valued random variables with 
the same marginal distribution as that of the random variables ^fc, k e Z; 
(a) this sequence ^ is independent of the a -field A; (Hi) this sequence ^ is 
two-sided standard a.s.; and (iv) defining the random variable r to be the 
analog of the right hand side of (5.2.1), with il^_f replaced by Cn-i f^''^ each 
^ e {0, 1, . . . , 5}, one has that Er < 6 ■ (8/5)3° . (8/3)6. 

Proof. Statement (A) holds trivially by (5.1.1) and its entire sentence 
(since the 6x6 identity matrix has 30 O's and 6 I's). 
Next, the {0, l}-valued random variables 

(5.2.2) z,:=i{[ek_,\ek-4\---\ek]-h), 

k G {. . . , —12, —6, 0, 6, 12, ... } are independent and identically distributed 
with P{Zk = 1) = (5/8)30 . (3/g)6 > g. Hence by two applications of the 
strong law of large numbers, statement (B) holds. 

Next, defining the random variable T := min{m > 1 : Zq^ = 1} (see 
(5.2.2)), one has that r < 6T a.s. by (5.2.1), and hence Er < 6 ■ ET. 
Of course T is finite a.s. and has a geometric distribution: For each n G N, 
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P{T = n) = (1 where p := (5/8)^°- (3/8)^. Hence as a standard fact 
(see e.g. [27, p. 212, Example 3, Problem 1]), ET = 1/p = (8/5)3° . (8/3)6. 
Statement (C) follows. 

Proof of statement (D). Suppose first that m is a positive integer. 
Next, suppose A e Ais such that P{A) > 0. 

Next, suppose j{—m),j{—m + l),...,j(m) are 2m + 1 integers such 
that the event F := rC=-m{^i'>^) = i(^)} satisfies P{Fr\A) > 0. Then (see 
Section 2.5(A)), since F n A e A, 



= A X ... X A, 

the (2m+l)-order product measure (here and below), where A is the marginal 
distribution (on {0, 1}^) of the ^«;'s. 



. . . , I A) = A X . . . X A. By the same argument with A replaced by Q, 



Since A E A (with P{A) > 0) was arbitrary, it now also follows that the 
random vector {^-m, ^-m+i, • ■ ■ , Cm) is independent of the u-field A. 

Since m e N was arbitrary, conclusions (i) and (ii) in statement (D) now 
follow from standard measure-theoretic arguments. Finally, conclusions (iii) 
and (iv) in statement (D) now follow from an application of statements (B) 
and (C) to the sequence ^. This completes the proof of statement (D), and 
of Lemma 5.2. 

Lemma 5.3. The random sequence U in Construction 5.1(B) (equation 
(5.1.3)) is a strictly stationary, irreducible, aperiodic Markov chain with state 





It follows from a simple application of Remark 2.8 that C{C-m, C-m+ij 



^{C-m, • • • , Cm) — A X ... X A. 
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space {1,2,3,4,5,6}, with invariant marginal distribution given by 

(5.3.1) P{Uo=j) = l/6 Vje {1,2,3,4,5,6}, 

and with one-step transition probability matrix [pij, 1 < i,j < 6) (where 
Pij = P{Ui = j \ Uo = i)) given by 

(5.3.2) 5/8 /or i G {1, 2, 3, 4, 5, 6}, 
Pi,i+i:=3/8 /orie {1,2,3,4,5}, 

P61 '•= 3/8, and 

Pij '■— for all other ordered pairs {i,j)- 

Proof. Since the sequence ^ := (^fe, /c e Z) of {0, l}^-valued random 
variables is i.i.d., the strict stationarity of the sequence U is a standard 
consequence of (5.1.3). Also, the random variables Uk, k E Z take their 
values in the set {1,2,..., 6} by e.g. (5.1.5). 

Our next task is to show the following: If i and j are each an element of 
{1, 2, . . . , 6}, K is an integer, A e o'iUKi Uk-i, Uk-2, • • • ) is an event, and 
P{A n {Uk = i}) > 0, then 

(5.3.3) P{Uk+i =j\An{UK = i}) 

= P {Uk+1 = j \ Uk = i) = Pij 

where Pij is as defined in (5.3.2). Once that is established, it will follow 
that the sequence U is a Markov chain with one-step transition probability 
matrix (5.3.2). From that matrix, it will then be easy to see that the Markov 
chain U is irreducible (by the second and third lines in (5.3.2)) and aperi- 
odic (by the first line in (5.3.2)). Also, it is easy to show that the (unique) 
invariant distribution on the state space {1,2,..., 6} for the one-step tran- 
sition probability matrix (5.3.2) is the uniform distribution on {1,2,..., 6} 
(as in (5.3.1)). Thus, once (5.3.3) is verified, the proof of Lemma 5.3 will be 
complete. 
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We shall verify (5.3.3) for the case where K = 0, i e {1, 2, 3,4, 5}, and 
j = i + By similar arguments and strict stationarity, one can verify (5.3.3) 
in the other cases. 

Suppose A e a{Uo, U^i, U^2, • • ■) and P{A n {Uq = i}) > 0. For any 
a; e ri such that Uo{u) = i, one has by (5.1.3) and Lemma 4.4(A) that 



Also, the event Ar\{Uo = i} is a member of the cr-field (t{^o, ^_2, . . . ) (see 
(5.1.3) again) and is therefore independent of the ({0, l}^-valued) random 
variable ^i. Hence by (5.3.4) and (5.1.1), 



(5.3.5) P{Ui =i + l\An{UQ = i})= P{Ci,i+i = l\An{UQ = i}) 



Applying the same argument with A replaced by Q, one has that P{Ui = 
i + 1 \ Uq = i) = 3/8. Since := 3/8 by (5.3.2), one now has by (5.3.5) 

that (5.3.3) holds (for the case K = 0, z e {1, 2, . . . , 5}, and j = i + l). That 
completes the proof of Lemma 5.3. 

Lemma 5.4. The random sequence W in Construction 5.1(B) (equation 
(5.1.4)) is strictly stationary and has the following properties: 

(A) The sequence W satisfies Condition S a.s. (see Definition 2.3(A)). 

(B) The (marginal) distribution o/Wq (on {0, 1, 2, 3, 4, 5, Q}) is given by 
P{Wo = 0) = 5/8 and P{Wq = i) ^ 1/16 for all i e {1, 2, 3, 4, 5, 6}. 

(C) For each j G Z, the {Ojl}-valued random variable I{Wj ^ 0) is 
independent of the o -field a{Uk, Wk, k < j — 1). 

(D) The {0, l}-valued random variables I{Wk ^ 0), k & Z are indepen- 
dent and identically distributed, each taking the value resp. 1 with probabil- 
ity 5/8 resp. 3/8. In fact for each j G Z, the random sequence {I{Wk 7^ 0), 
^ ^ {jij + 1; J + 2, . . . }) is independent of the a~field a{Uk, Wk, k < j — 1). 

The redundancies here (statement (C) is a special case of (D), and 
(T{Uk,Wk, k < j — 1) = (T{Uk, k < j — 1) hy (5.1.4)) are for convenient 
reference. 



(5.3.4) 




P(ei,i+i = 1) = 3/8. 
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Proof. Since the sequence ^ := (^fe, A; e Z) of {0, l}^-valued random 
variables is i.i.d., the strict stationarity of the sequence is a standard 
consequence of (5.1.4). Also, statement (D) (in Lemma 5.4) follows from 
statements (B) and (C), strict stationarity, and an elementary induction 
argument. Our remaining task is to prove statements (A), (B), and (C). 

Statement (A) holds by Lemma 5.2(B), equation (5.1.4), and Lemma 
4.6(A). 

To prove statement (B), first note that (see (5.1.5)) P{Wq = 0) = 1 — 
ELi^(^o = i)- Hence to prove (B) it suffices to prove that P{Wo = i) = 
1/16 for each i e {1, 2, . . . , 6}. But that holds by (5.1.7) and Lemma 5.3; for 
example, for i = 6 one thereby has 

P{Wo = 6) = P{Uo = 6, U-i = 5) = P{U-i = 5) • P{Uo = 6 | f/_i = 5) 

= (1/6) . (3/8) = 1/16. 

Thus statement (B) holds. 

Proof of statement (C). The argument is the same for any j e Z. 
We shall give it for j = 1. By (5.1.7), a{Uk,Wk, k < 0) = a{Uk, k < 0). 
Our task is to prove that the {0, l}-valued random variable I{Wi ^ 0) is 
independent of the u-field (T(C/fc, k < 0). 

Let m e N be arbitrary but fixed. By a standard measure-theoretic 
argument, it suffices to show that the random variable I{Wi ^ 0) is inde- 
pendent of the random vector {Uq, U-i, U-2, . . . , U-m)- 

Referring to (5.1.5), suppose io,^i, ■ ■ ■ ,im are each an element of {1, 2, 
...,6}, and that the event F := PlfcLol^-fc = ^fc} satisfies P{F) > 0. It 
suffices to show that 

(5.4.1) PiliWi ^ 0) = I F) = P(/(W^i ^0) = 0). 

(For then by taking complements, one also obtains P{I{Wi 7^ 0) = 1 | F) = 
P{I{Wi 7^ 0) = 1).) The right side of (5.4.1) is of course simply P{Wi = 0), 
which is 5/8 by statement (B). By (5.1.7) and Lemma 5.3, the left side of 



39 



(5.4.1) is simply 



P{Wi = I F) = P{Ui = C/o I F) = P{Ui = io I F) 



P{Ui =io\Uo = io) = 5/8. 



Thus (5.4.1) holds. That completes the proof of statement (C), and of 
Lemma 5.4. 

Lemma 5.5. Refer to Construction 5.1(B), Lemma 5.4(A) (B), and 
Definition 2.3(A). Define the random variable 



Then E{T \Wq^I) = 1Q and Var(T | VTq = 1) = 80/3. 

Proof. For convenience, for each /c > 1, define the {0, l}-valued ran- 
dom variable Vk := /(W^ 7^ 0). By Lemma 5.4(D) (both sentences of it), 
conditional on the event {Wq = 1}, the random variables Vi, V25 V3, . . . are 
independent and identically distributed, each taking the value resp. 1 with 
probability 5/8 resp. 3/8. By Lemma 5.4(A) (see Definition 2.3(A)) and 
(5.5.1), for P-a.e. u e {Wq = 1}, 



Hence conditional on the event {Wq = 1}, the random variable T has the 
"negative binomial" distribution with parameters r = 6 and p = 3/8. Hence 

by standard elementary calculations (see e.g. [27, pp. 213-215, Example 4, 
Problem 2]), E{T | VTq = 1) = r/p = 16 and Var(T \ Wq = 1) ^ r(l - 
p)/p^ = 80/3. Thus Lemma 5.5 holds. 

Lemma 5.6. Refer to Section 2.7(B) and the sequence W in Construc- 
tion 5.1(B). For any given J &Ti, the ordered triplet 



(5.5.1) 



T := min{A; e N : = 1}. 




(5.6.1) 



{a(Wk, k < J), {Wj = 1}, a{Wk, k > J)) 



is a restricted Markov triplet. 
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Proof. By strict stationarity (see Lemma 5.4), it suffices to give the 
argument for J = 0. 

Refer to Section 2.7(A). We shall use some standard elementary prop- 
erties of Markov triplets (see e.g. [5, Vol. 1, Appendix, Section A701]). By 
Lemma 5.3, 

iaiUk,k<-2), (7(t/_i,C/o), aiUk,k>l)) 
is a Markov triplet. Hence so is 

(cT(C/fe,/c<0), a(t/_i,t/o), cT(C/fc,/c >-!)). 

Hence (trivially) by (5.1.7), so is 

(5.6.2) {a{Wk, k < 0), a{U-i, Uq), a{Wk, k > 0)). 

Now by (5.1.7), {Wq = 1} = {Uq = 1} D {?7_i = 6}, which is an atom of 
the cr-field cr(t/_i, Uq). Hence from the Markov triplet (5.6.2), one has that 
(5.6.1) is (for J = 0) a restricted Markov triplet. That completes the proof. 

6. Scaflfolding (part 1) 

Throughout the rest of this paper, the context will be a particular prob- 
ability space (n,.F, P), rich enough to accommodate all random variables 
defined henceforth. With or without explicit mention, many of those "ran- 
dom variables" will be random vectors or random sequences, taking their 
values in spaces such as ({0, 1}^)^ or {—1, i].sxtp(n)_ 

Sections 6 (here), 7, and 8 will provide "scaffolding" that will be used 
for the definition (in Section 7) of the random sequence X for Theorem 1.1 
and for the proofs of the various properties of X stated in that theorem. 

Construction 6.1. (A) On our probability space {Q,J^,P), let 
n e N, e Z, z e {1,2,3,4,5,6} be an array of independent, identically 
distributed {0, l}-valued random variables such that for each (n, k, i), 

(6.1.1) P{if-0)=5/8 and P (cI? = l) = 3/8. 
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From those random variables, for convenient reference, for each n e N and 
each A; e Z, define the {0, l}^-valued random variable (random vector) 

Of course those random variables ^^^\ n E ISf, k E Z are independent and 
have the same distribution (a product measure) on {0, 1}^. From those 
random variables, again for convenient reference, for each n G N, define the 
random sequence :— {Ck^\ /c G Z). 

(B) For each n G N, the random sequence ^'^"^ here has (trivially) the 
same distribution (on ({0, 1}^)^) as the random sequence ^ in Construc- 
tion 5.1. Henceforth, theorems involving the random sequence ^ in Section 5 
will be applied freely to each of the random sequences n G N here. 

(C) Referring to (6.1.2), for each n G N and each A; G Z, define the 
({0, l}^)"-valued random variable 

(6.1.3) f<"'-(fi",ef,...,d"')- 

— (n) 

Of course, for any particular n G N, those random variables , /c G Z are 
independent and identically distributed. For convenient reference, for each 

— (n) —M 

n G N, define the resulting random sequence ^ '■= {^k , k e Z). 

(D) Again referring to (6.1.2), for each k e Z, define the ({0,1}^)^- 
valued random variable 

(6.1.4) er-(ei".«f.«f,...)- 

Of course those random variables are independent and identically dis- 
tributed. Define the resulting random sequence := (Cfe°°\ /c G Z). 

Construction 6.2. For each n g N, we shall define a sequence 
:= (Vr^"\ G Z) of {0, l,2,3,4,5,6}-valued random variables such 
that (see Section 2.6 and Construction 6.1(C)) 

(6.2.1) the ordered pair (W("), ) satisfies Condition M. 
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Also, for each n e N, we shall define an event ^^^^^ such that 

(6.2.2) P = 1 
and (see Section 2.3) 

(6.2.3) for each to E 0^"J,^, the sequence W^(")(cc;) 

of elements of {0, 1, . . . , 6} satisfies condition S. 

Also, for each n G N, we shall define nonnegative integer-valued random vari- 
ables ^{n, k,j), k E Z, j E {0, 1,2,...}, such that for each j e {0, 1,2,...}, 
defining the random sequence '^{n,j) := {'^{n,k,j), k e Z), one has that 
(see Section 2.6 again) 

(6.2.4) the ordered pair (*(n, j), W^^")) satisfies Condition M. 

The definition will be recursive — starting with just W^^^ and Og^^^^, and 

then (for the recursion step) set up with ^{n,j) defined together with W^'^'^^^ 

and n^''^^^ 
''good • 

Initial step. First, define the sequence 
{0, 1, ... , 6}-valued random variables as follows: For each k E Z (see (6.1.2) 
and Definition 4.5), 

(6.2.5) Wt'^ := ^.paced . . .) . 

Obviously (see Sections 6.1(B) and 2.6) equation (6.2.1) holds for n = 1. 

Also, let figood denote the set of all a; G O such that the sequence 
^^^\uj) := {^''k\oj), /c G Z) of elements of {0,1}^ (see the very end of 
Construction 6.1(A)) is two-sided standard (see Notations 2.4(D)). Equa- 
tion (6.2.2) holds for n = 1 by Lemma 5.2(B), and equation (6.2.3) holds for 
n = 1 by Lemma 4.6(A). 

Recursion step. Now suppose n G N, and the event f^goo^ 
sequence 

^(n) (^W^ G Z) of {0,l,...,6}-valued random variables 
are already defined and satisfy (6.2.1), (6.2.2), and (6.2.3). 
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(A) For each A; e Z and each j e {0, 1,2,...}, define the nonnegative 
integer-valued random variable ^{n, k,j) by (see Definition 2.2) 

(6.2.6) ^{n,k,j) := V', {wt^\wi%wi% . . .) . 

Now by (6.2.1) and Definition 2.6, the sequence VF^") is strictly stationary. 
Hence by (6.2.6), equation (6.2.4) holds for every j > 0. 

(B) Next, define the sequence Ti^^'^+i) := {wl''^^\ A; G Z) of {0,1, 
. . . , 6}-valued random variables as follows: For each A; e Z and each a; e 1), 
referring to Definition 4.5 and (6.2.6), 

(6.2.7) 

'0 ifwt^\uj)^l 

/ t(n+l)/ N, <^(n+l) / X 

^ ^i-";\U2)MH>^&lM) ifW^r(a;) = l. 

Verification of (6.2.1) with n replaced by n + 1. For each j > 0, each 
A; e Z, and each a; e f2, by (6.2.6), 



u=0 



Now by (6.2.4), (6.2.1), and Definition 2.6 (and a trivial argument), for each 

— (n) 

j > 0, the ordered pair (^(/i, j), ^ ) satisfies Condition Hence by (6.2.8) 
and Construction 6.1(C), for each j > 0, the ordered pair 

satisfies Condition M.. Hence by (6.2.1) for the given n, (6.2.7), and Con- 
struction 6.1(C), equation (6.2.1) holds with n replaced by n + 1. 

(C) Our final task in the recursion step is to define the event ^^^^d^ and 
then to verify (6.2.2) and (6.2.3) with n replaced by n+ 1. To facilitate this, 
we shall define a couple of other random sequences. 

Define the random strictly increasing sequence k^'^^ := {K,{n,j), j e Z) 
of integers as follows: Referring to (6.2.2) and (6.2.3) (for the given n) and 

44 



to Section 2.3, for each lo e ^good' define the integers K(n,j)(a;), j G Z 
(uniquely) by 

. . . < K{n, -2){oj) < K{n, -l){oj) < K{n, 0){oj) < 

(6.2.9) < 1 < K{n, 1){lu) < K{n, 2){uj) < K{n, 3){lu) < . . . 

and 

(6.2.10) 

[keZ: W!^''\u;) = l} = {. . . , K{n, -l){u;), «(n, 0)(a;), «(n, l)(a;), . . .}. 

(The sequence k.^'^^ can be left undefined on the null set (^^goia)'^-) -^^ 
(6.2.1) and (6.2.9)-(6.2.10), a(K('^)) C a(|^"^), and hence by Construction 
6.1(A)(C), the sequence k^'^^ is independent of the sequence Hence 
by Lemma 5.2(D) (and Section 6.1(B)), 

(6.2.11) the sequence (Ci'(n Jj' j ^ ^) i-i-<i- with the 

same marginal distribution as the in Construction 5.1; 

(6.2.12) 

the sequence (^^'(^j], j £ Z) is independent of the cr-field cr{$,^^^); and 
(6.2.13) 

the sequence (^^'^^Jj, j € Z) is two-sided standard a.s. (see Section 2.4(D)). 

Let ^^good"* denote the set of all lo e ^good ^^^^ ^^^^ sequence 
(^i'(n ^ ^) elements of {0,1}^ is two-sided standard. Then 

by (6.2.13), equation (6.2.2) holds with n replaced by n + 1. 

Verification of (6.2.3) with n replaced by n + 1. Refer to (6.2.6), (6.2.9)- 

(6.2.10) , and Definition 2.2. For each u> e ^good^ ^^'^^ £ G Z, and each 
i >0, 

*(n,K(n,£)(a;),j)(a;) = K.{n,e){uj) - K{n,£-j){uj) 

and hence 

K{n,£){u) - *(n, K(n,£)(a;), j)(a;) = K{n,£ - j){uj). 
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Hence for each uj e Q.^^^'^l^ and each £ G Z, by (6.2.7) and (6.2.10), 
(6.2.14) 

^i(n/)(a;)('^) ^ fl'spaced (cl(n,^)(a;) Ci(n,£-l)(a)) ('^)' ^i(n,£-2)(a.) ('^)' • • •) • 

By (6.2.14), the definition of and Lemma 4.6(A), one has that for each 

ijO e i^good\ the sequence (W^i^J^l)(^)('^), G Z) of elements of {0, 1, ... , 6} 
satisfies Condition S. Also, by (6.2.7) and (6.2.10), for each uj e ^^^^^^ ■, one 
has that 

(6.2.15) W^^"+')(a;) = 

for all A; e Z — {. . . , ^(n, — l)(a;), K(n, 0)(a;), K(n, 1)(<^), . . .}. 

Hence by Remark 2.3(C), equation (6.2.3) holds with n replaced by n + 1. 
This completes the recursion step and Construction 6.2. 

Section 6.3. This builds on the material in Constructions 6.1 and 6.2. 
(A) Referring to the events f^gooj, n e N in Construction 6.2, define the 
event 

oo 

(6.3.1) ^^0 := n Cd- 
Then by (6.2.2), 

(6.3.2) P{VLq) = 1. 

Also, by (6.2.3), (6.2.10), and the definitions of the events i^gooj, n e N in 
Construction 6.2, one has the following: 

(i) For each uj E flo and each n e N, the sequence {wl^\uj), k E Z) 
of elements of {0,1,..., 6} satisfies Condition S. (Again recall Definition 
2.3(A).) 

(ii) For each uj e Qq, the sequence (^^^^(a;), keZ) of elements of {0, 1}^ 
is two-sided standard. 

(iii) For each uj e CIq and each n e N, the sequence (^]"'"'""^^(a;), j G {k e 
Z : Wl''\uj) = 1}) (see Section 2.2(F) (n)) is two-sided standard. 
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(B) Remark. From (6.2.7), one has that for a given n e N, A; e Z, 
and u;en,if wI:'"\uj) ^ 1 then M^^"+^^(w) = 0. Thus for a given k eZ 
and a; G O, the sequence {Wl'^\uj),wl:^\uj),wlf\u),...) of elements of 
{0, 1, . . . , 6} will have one of the following five forms: 



(i) (0,0,0,...), 

(u) (z, 0,0,0,...) where i e {2, 3, 4, 5, 6}, 

(iii) (1,1,. ..,1,0,0,0,...), 

(iv) (1,1,..., 1, i, 0, 0, 0, ... ) where i e {2, 3, 4, 5, 6}, 

(v) (1,1,1,...). 



(In (iii) and (iv), the number of I's can be any positive integer.) 

(C) Remark. Recall the first sentence of Remark (B) above. By Remark 
2.3(B) and remark (i) in Section (A) above, one has the following: For any 
n e N, any uj & Qq (see (6.3.1)), and any pair of integers J and L such that 
J < L, one has that 



(6.3.3) card{/ceZ: J<k<L and Wf^'>{io) = l} 



< 1 + (1/6) • card{A; e Z : J <k<L and W^^"+^^(a;) ^ 0} 

< 1 + (1/6) • cardj/c e Z : J <k<L and wl^'"\io) = 1}. 



(D) Remark. For each n e N, each k e Z and each u e Qq, 



by (6.2.6) and Definition 2.2, since (again see Remark (B) above) the second 
set in (6.3.4) is a subset of the first; equivalently 



(E) Referring to (6.2.5) and (6.2.7), for each n e N and each k e Z, 
define the {0, 1, ... , 6}"^-valued random variable 



(6.3.4) 




(6.3.5) 



k - *(n, k, 0)(w) >k- *(n + 1, k, 0){u;). 



(6.3.6) 
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Accordingly, for each n e N, define the random sequence W := {Wf^ , 
k e Z). By (6.2.1) and Definition 2.6(A) (and Construction 6.1(C)), for each 
n e N, 

(6.3.7) The ordered pair {W ,^ ) satisfies Condition A4. 

(F) Remark. Of course the random sequence in (6.2.5) has the same 
distribution (on {0, 1, . . . , 6}'^) as the random sequence W in Construction 
5.1(B), by (6.2.5), (5.1.4), and Construction 6.1(B). 

(G) Remark. For each n e N, the random sequence {wj^^^^y j e Z) 
(recaU (6.3.1), (6.3.2), (6.2.9), (6.2.10), and (6.2.14)) has the same distri- 
bution (on {0, 1, . . . , 6}^) as the random sequence W := (Wj, j G Z) in 
Construction 5.1(B). (This holds by (6.2.11), (6.2.14), (5.1.4), and a stan- 
dard measure-theoretic argument.) 

(H) Remark. For each n e N, the random sequence {wj^^^^y j e 

— (n) 

Z) (recall (G) above) is independent of the sequence ^ , by (6.2.14) and 
(6.2.12). 

Lemma 6.4. (A) For eachie {1,2, ...,6}, P{W^^^ = i) = 1/16. 

(B) If n e N and A e a{W ) (see section 6.3(E)) are such that 
P{An{W^""^ = 1}) > 0, then for each i e {1,2, ...,6}, P{W^"'^'^^ = i \ 
AniW^""^ = 1}) = 1/16. 

(C) For each neN and each i e {1, 2, . . . , 6}, PiW^"^^ = i) = 16"". 

(D) Suppose n e N. Suppose S is a nonempty finite set C Z. Suppose 
A e aiW ). Suppose also that the event 

(6.4.1) F:=AP| 

satisfies P{F) > 0. Then conditional on F, the {0, 1} -valued random vari- 
ables I{wlf'~^^^ 0), k E S are independent and identically distributed, each 
taking the value resp. 1 with probability 5/8 resp. 3/8. 

Proof. Statement (A) holds by Lemma 5.4(B) and Remark 6.3(F). 
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To prove statement (B), note first that by (6.2.9)-(6.2.10), K{n, 0){u>) = 
for each uj e flo n {W^""^ = 1} (recall (6.3.1)-(6.3.2)). By (6.3.6), (6.3.7), 
and the hypothesis of statement (B), A n {W^^''^ = 1} e (j(W^''^) C a(|^"^). 
Hence for a given i e {1,2,..., 6}, by Remark 6.3(H), Remark 6.3(G), and 
Lemma 5.4(B), 

p (wt^'^ =i\An {wt'^ = i})=P {wi'l;^l] = t\An {wt^ = i}) 

= P (<ntoj =^)= PiWo =i) = 1/16 

(where Wq is as in Construction 5.1(B)). Thus statement (B) holds. 

Statement (C) holds forn = 1 by statement (A). Also, for a given n e N 
for which Statement (C) holds, and a given i e {1,2,..., 6}, one has that 
{VF^3^^+^^ - i} C {W^""^ = 1} by Remark 6.3(B), and hence by statement (B) 
(in Lemma 6.4), 

P(W^q("+i) = i) = p(vro^") = 1) . P(W(S^+^) = i I W^o^") = 1) 
= P{W^''^ = 1) • 1/16 = (1/16)^+^ 
Now statement (C) holds for all n e N by induction. 

Proof of (D). Let m := card S. Let A denote the "Bernoulli" probability 
measure on {0, 1} given by A({0}) = 5/8 and A({1}) = 3/8. In the argument 
below, the notation A x . . . x A will mean the m-fold product measure on 
{0,1}-. 

Let the elements of S be denoted by s{i), 1 < i < m where s{l) < s{2) < 
... < s{m). Refer to (6.2.9)-(6.2.10) and to (6.3.1)-(6.3.2). For each m-tuple 
3 ■= (i(l)>j(2),---,j("^)) of integers such that < j{2) < ... < j{m), 
define the event 



F{j) :=Ff|^^on 



f]{n{n,j{u)) = s{u)} 



Those events F{j) are (pairwise) disjoint (and some of them will be empty), 
and by (6.4.1) and (6.2.9)-(6.2.10) their union is FnQo = F. Also, for each 

(„) —(n) 

such j, one has that F{j)ea{W^ ') C a(f ') by (6.3.6), (6.3.7), and the 
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hypothesis of statement (D) (since by (6.2.9)-(6.2.10) the random variables 
K{n,i), i&Ti are (T(VF*^"^^)-measurable modulo the null-set 

Hence by Remark 6.3(H), Remark 6.3(G), and Lemma 5.4(D) (see Sec- 
tion 2.5(A)), for each such m-tuple j, 

C (/(W^i("if ^ ^ 0), m^'l^;^ ^ 0), . . . , /(W^i("+/) ^ 0) I F(i)) 
= ^ 7^ 0), /(<;;j2)) ^ 0), . . . , /(<5(L)) ^ 0) I F{j)) 

= ^ ^ 0), /(<+;;,, ^ 0), . . . , /(<t.t, ^ 0)) 

= A X ... X A. 

Hence by Remark 2.8, 

C (/(W^i(^if ^ ^ 0), /(^yi(",f ^ ^ 0), . . . , /(W^i("+/^ ^ 0) I f) = A X ... X A. 

Thus statement (D) holds. Lemma 6.4 is proved. 

Lemma 6.5. Suppose n e N. T/ien for each integer J, the ordered 
triplet 

{a(Wt'\k<J), {Wj^^^l}, a{W^:\k>J+l)) 

is a restricted Markov triplet (see section 2.7(B)). 

The slight "asymmetry" in this statement is just a matter of convenience. 
This statement is slightly stronger than what will be needed in its application 
later on. 

Proof. For n = 1, this holds by Lemma 5.6 and Remark 6.3(F). 

Now for induction, suppose is a positive integer and Lemma 6.5 holds 
for n — N. Our task is to show that it holds for n = + 1. 

Of course by (6.3.7) (with n = A"-|-l) and Definition 2.6(A), the sequence 
^{N+i) gij.[(,iiy stationary. Hence it suffices to carry out the argument in 
the case where (n = A" -|- 1 and) J = 0. 

Refer to (6.2.9)-(6.2.10) for n = N. For convenient notation, define 
the sequence Z* :— {Z*, j e Z) of {0, 1, ... , 6}-valued random variables as 
follows: For each j G Z 

(6.5.1) Z^ — W'^^+^I 
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By the induction hypothesis, 

(.(Wr',*;<0), = 1}. <^(W<'",A>1)) 

is a restricted Markov triplet. By (6.5.1), Remark 6.3(G), and Lemma 5.6, 

{a{z;j < 0), {Zo* = 1}, a{z;j > 0)) 

is a restricted Markov triplet. Hence by (6.3.7), Remark 6.3(H), and Re- 
mark 2.7(D), 

(6.5.2) (a(Wr\ /c < 0) V aiZ*J < 0), {W^""^ = 1} n {Z*, = 1}, 

a{Wi''\k>l)ya{Z*,j>l)) 

is a restricted Markov triplet. 

Next, by (6.2.9)-(6.2.10) and a simple argument, 

(6.5.3) a{K{N,j),j <0)ca{wl^\k <0) and 



(6.5.4) a{K{N,j),j>l)ta{W^''\k>l). 

Of course by (6.2.9)-(6.2.10), (6.5.1), and (6.2.7), for a given /c < and 
a given a; e fio (see (6.3.1)-(6.3.2)), 
(6.5.5) 

^ / if /c ^ {^(iV, 0)(c^), KiN, -l)(a;), k{N, -2)(a;), . . .} 

^^k K^) - I z* {to) if /c = k{N, j) (w) for some j < 0. 

Hence by (6.5.3) (and (6.3.6)), 

(6.5.6) <T{wt''+'\k< 0) C a{K{N,j),j < 0) Va(Z;, j < 0) 

Ca{Wi''\k<0)y a{Z*, j<0). 

Hence by (6.3.6) again, 

(6.5.7) a(Wr^'\ k<0)c a{Wi''\k < 0) V a{Z;,j < 0). 
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Next, as an analog of (6.5.5), one has that for A; > 1 and uj e Q,q^ 
Wl^^^\uj) = resp. Z*{u) if /c ^ {k{N, l){u;), K{N,2){ij), k{N,3){u), . . .} 
resp. k = K{N,j){u)) for some j > 1. Then by (6.5.4), one obtains an analog 
of (6.5.6) with the inequalities k <0 and j < replaced hy k > 1 and j > 1. 
Thereby one obtains the following analog of (6.3.7): 

(6.5.8) a{Wi''+'\k> 1) C a{Wi''\k> 1) Va(Z;,j > 1). 
Now by Remark 6.3(B) and (6.2.9)-(6.2.10) and a simple argument, 

{W^^+^^ = 1} C {W^^^ = 1} = {k{N, 0) = 0}. 
As a trivial consequence, by (6.5.1) for j = 0, 

(6.5.9) {w^^+^^ = 1} = {w^^+^^ = 1} n {w^^^ = 1} n {k{n, o) = 0} 

= {^if^ti) = 1} n {w^ = 1} n {k{n, 0) = 0} 
= {z* = 1} n {w^""^ = 1} n {Av(iv, 0) = 0} 
= {z* = 1} n = 1}. 

Now by (6.5.7), (6.5.8), (6.5.9), and the entire sentence containing (6.5.2), 
one has that 

is a restricted Markov triplet. That completes the induction step and the 
proof of Lemma 6.5. 

Lemma 6.6. Suppose n G N. Referring to section 6.3(A) (equa- 
tions (6.3.1) and (6.3.2) and statement (i)), Definition 2.3(A), and Lemma 
6.4(C), define the positive integer-valued random variable 

(6.6.1) T^'^) := min{A; e N : wj^'"'^ = 1}. 
Then 

(6.6.2) E (t^""^ W^""^ " " 
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(6.6.3) Var (t^""^ Wq^"^ " " (hence) 

(6.6.4) E (^(t("))2 1^(5") = l) < 2 • 16^". 

Proof. For n = 1, this holds by Lemma 5.5 and Remark 6.3(F). Now 
for induction suppose N e'N and Lemma 6.6 holds for n = N. Our task is 
to show that it holds for n — N + 1. 

By (6.2.9)-(6.2.10), 

(6.6.5) T^^) = k{N, 1) a.s. 
and also 

(6.6.6) {^0^^ ^ " 

As in the proof of Lemma 6.5, define the sequence Z* := (Z*, j E Z) 
of {0, 1, ... , 6}-valued random variables by (6.5.1). Then (6.5.9) holds. We 
shall refer to both (6.5.1) and (6.5.9) freely below. 

By (6.5.1), Remark 6.3(G), and Lemma 5.4(A), the sequence Z* satis- 
fies Condition S a.s. (see Definition 2.3(A) again). Accordingly, define the 
positive integer-valued random variable M as follows: 

(6.6.7) M := min{j eN:Z* = 1}. 
By (6.5.1), Remark 6.3(G), and Lemma 5.5, 

(6.6.8) E(M I = 1) = 16 and Var(M \ Z^ = 1) = 80/3. 

Next, by (6.5.1), Remark 6.3(H), and (6.2.1), the sequences W^^^ and 
Z* are independent of each other. It follows from (6.5.9), (6.6.7), and a 
simple calculation that E{M \ Z* = 1) = E{M \ W^^^^^ = 1) and Var(M | 
Z* = 1) = Var(M | W^^^^'^ = 1). Hence by (6.6.8), 

(6.6.9) E{M I W^^^^'^ = 1) - 16 and Var(M | W^^^'^^ = 1) = 80/3. 
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Now for every oj E ^Iq (see (6.3.1)-(6.3.2) again), one has the follow- 
ing: For any j e {1, 2, . . . , M(u;) - 1} (if M{u) > 2), W^^^+'^^^^^iu) = 
Z*{u) ^ 1 by (6.5.1) and (6.6.7). For any A; G Z - {k{NJ){u) : j E Z}, 
Wl^^^^\u) = by (6.2.9)-(6.2.10) and Remark 6.3(B). Hence (for u G Oq), 
for alike {l,2,...,K(7V,M(a;))(a;)-l}, ^^^^^+^^(0;) ^ 1. Also (for a; G l^o), 
= ^mm(^) = 1 by (6.5.1) and (6.6.7). 

By the preceding two sentences (sec (6.3.1)-(6.3.2) again) and (6.6.1), 

(6.6.10) T^^+i) = Av(iV, M) a.s. 

Now let us look at the random variables k{N, j) — k{N, j — 1), j G N. By 
Lemma 6.5 and the strict stationarity of the sequence W^^^ (recall (6.2.1) 
and Remark 2.6(B)), one has the following: For any positive integers J and 
e, and any event A G (t(W^^\ k<J-l) such that P(Ar]{W^^^ = 1}) > 0, 
one has that (see Remark (2.7) (C)) 

p(w^jf. ie {!,...,£-!} and W^jf^ = iIad {wf^ = 1}^ 

= P(W^J+I^iy ie {!,...,£ -1} and W^jf^ = l\wf^ = 1^ 
= p(|w^W ^ 1 Vz G {1,...,£-1} and W^^^ = l\w^^^ = iy 

(Of course for £ = 1, omit the phrases Wj^] ^ 1 resp. wj;^'' ^ 1 ^ i e 
{1, . . . , £ — 1}.) Hence (sec (6.2.9)-(6.2.10) again), by a standard induction 
argument, one can show that conditional on the event {M^d'^'* = 1}, the ran- 
dom variables k{N, 1) (or k{N, 1)-k{N, 0) — see (6.6.6)), k{N, 2)-k{N, 1), 
K,{N, 3) — K,{N, 2), K,{N, 4) — K,{N, 3), . . . are independent and identically dis- 
tributed, with (see (6.6.6), (6.6.5), and (6.2.9)-(6.2.10)) 

C{k{N, 1) - k{N, 0) I W^^^ = 1) = jC{k{N, 1) I W^^^ = 1) 

= £(tW|H^o^^^=1). 

Hence by (6.5.9), the sentence after (6.6.8) (recall that a{K{N,i))ca{W^^^) 
for i G Z by (6.2.9)-(6.2.10)), and a standard trivial calculation, conditional 
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on the event {Wq^'^^^ = 1}, the random variables K{N,j) — K{N,j — 1), 
J G N are independent and identically distributed, with 

(6.6.11) jC{k{N, 1) - KiN, 0) I W^^+^^ = 1) 

= C{k{N, 1) - k{N, 0) I W^^^ = 1) = £(T(^) I W^^^ = 1). 

Hence by the induction hypothesis of (6.6.2) and (6.6.3) for n = N, 

(6.6.12) E{k{N, 1) - k{N, 0) I Wq^^^^^ = 1) = 16^ and 

(6.6.13) Var(Av(iV, 1) - k{N, 0) | W^^+^^ = 1) < 16^^. 

Now recall again from (6.2.9)-(6.2.10) that a{K{N,i),ie Z)ca{W^^^). 
By that fact, (6.6.7), and the sentence after (6.6.8), and equation (6.5.9), to- 
gether with a standard simple argument, conditional on the event {Wq^~^^^ = 
1}, the random variable M is independent of the random sequence {k,{N, j) — 
k{NJ - 1), j E N). Hence by (6.6.10), (6.6.9), (6.6.12), (6.6.13), the entire 
sentence containing (6.6.11), and a well known elementary calculation (see 
e.g. [15, p. 301, Exercise 1]), one has that (recall (6.6.6) and (6.5.9)) 

e(t(^+i) I W^''+'^ = 1) = E{k{N, M) I wi,''^^^ = 1) 



. M 

= E(^[«(Ar,j)-«(^,i-i)] 

= E{M I = ^)-E{ k{N, 1) - k{N, 0) I W^^^^^ = 1) 

= 16 • 16^ = 16^+1 

and 

Var(T(^+i) I W^''+'^ = 1) = Var(«(iV,M) | ^^0^^+') = 1) 

= Var( 5^[«(iV, j) - n{N,j - 1)] ^^0^^+^) = 1] ) 
V i=l ^ 

= E{M I W^^+^^ = 1) • Var(Ac(iV, 1) - k{N, 0) | W^^+^^ = 1) 

+ Var(M I ^^0^^+') = 1) • [£;(«(iV, 1) - k{N, 0) | W^^^^^ = 1)]' 
< 16 ■ 16^^ + (80/3) ■ (16^)2 < 16^(^+1). 
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= 1 



Thus (6.6.2) and (6.6.3) (and hence also (6.6.4)) hold forn = TV + 1. That 
completes the induction step and the proof of Lemma 6.6. 

Lemma 6.7. Suppose n e N. Let Pn denote the probability that there 
exist at least two distinct integers i,j e {1, 2, . . . , 6 • 16"'} such that W^"^^ = 

Proof. Suppose n e N. Refer to (6.2.9)-(6.2.10). It suffices to prove 
that P{K{n,2) < 6 • 16") > 1/2, or 

(6.7.1) P(K(n,2) > 6- 16") < 1/2. 

Recall (from (6.2.1) and Remark 2.6(B)) that the sequence IS 
strictly stationary. Recall from (6.2.9)-(6.2.10) that ^(n, 1) = T(") a.s., 
where T*^") is as in Lemma 6.6, and that {«:(n, 0) = 0} = {VFq"^'' = 1}. From 
(6.2.9)-(6.2.10) and a trivial argument, followed by Lemma 6.4(C), one has 
that for each positive integer j, 

oo 

(6.7.2) P(K(n, 1) = j) = J2 Pitkin, 0) = -£ and K(n, 1) = j) 

oo 

= J]P(«(n,0) = 0, K{n,l)^j+£) 

oo 

= P{K{n, l)^j+£\ K{n, 0) = 0) • P{K{n, 0) = 0) 

= P{wl^''^ = 1) ■ P{K{n, 1) > J I K{n, 0) = 0) 
= 16"" • P(t(") > j I W^""^ = 1). 

Now for (say) any positive integer- valued random variable Z, one has 
by a simple argument that Yl'jLiJ ' P{Z > j) < EZ'^ . Hence by (6.7.2) and 
Lemma 6.6, 

oo 

(6.7.3) EK{n, 1) = ^ j • 16-" • P(T(") > j | W^^S"^ = 1) 

< 16-" • E (|(t("))2 wf^ ^) - ■ 2 ■ = 2 ■ 
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Now by strict stationarity of the sequence VF*^") , and a standard elemen- 
tary argument using Remark 2.8 (akin to certain arguments in the proof of 
Lemma 6.6), the random variable K{n, 2) — K{n, 1) is independent of ^(n, 1) 
and C{K{n,2) — ^(n, 1)) = ^(^(n, 1) | Wq"^^ = 1). Recall again from the 
paragraph after (6.7.1) that K,{n, 1) = T^'^\ from Lemma 6.6. One now has 
by Lemma 6.6 that 

E{K{n, 2) - K{n, 1)) = £;(T(") | W^""^ = 1) = 16". 

Hence by (6.7.3), EK{n, 2) < 3 • 16". Now (6.7.1) holds by Markov's inequal- 
ity. Lemma 6.7 is proved. 

7. Scaffolding (part 2) 

Among other things, this section will include (in Construction 7.5 below) 
the construction of the random sequence X itself for Theorem 1.1. This 
section will build on Section 6. Recall from that section the given probability 

space (O, JF, P). 

Construction 7.1. Refer to Construction 6.2, including equation 
(6.2.6). Define the {0, 1, 2, 3, 4, 5, 6}-valued random variables S^^\ n e N, 
A; e Z as follows: 

(7.1.1) := Wt''> 

and for n >2, 

(7 1 2^1 f^^"^ — M^^"^ 

By (7.1.1), (7.1.2), and (6.2.6), one has that for all k e Z, 

(7.1.3) (j(4'^) C(j(Ty(^^), and Vn > 2, (j(4"^) C (j(W^("-^), W^^")). 

Define the ({0} U N U {oo})-valued random variables Nk, k E Z as 
follows, for each G O, 
(7.1.4) 

( if Sl^\iv) = (that is, wl^\uj) = 0) 

Nk{uj) := < m G N if ^''^(c^) ^ V w G {1, . . . , m} and ^"'^^^(w) = 
[ oo if (^^) 7^ for all w G N. 
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By (7.1.4) and (7.1.3) (and (6.3.6)), for each m e N and each /c e Z, 

m 

(7.1.5) {AT, > m} = fl {5^^^ ^ 0} C a(W^"^^); 

u=l 

and for each integer m > 0, 

(7.1.6) {Nu = m} C (7(Tr^'"+'Y 

Also, define the integer- valued random variables J(m, A;), m e N, A; e Z 
as follows: 

m 

(7.1.7) J(m,/c):=5;6«-^(4")-l). 

ai=l 

By (7.1.3), for each m e N and each A; e Z, 

(7.1.8) c7(J(m,A;)) C (7(W^"'Y 

Remarks 7.2. Recall from Construction 7.1 that the random variables 
5^j^\ n e N, A; e Z take their values in the set {0, 1, . . . , 6}. 

(A) Suppose m G N, w G O, A; G Z, and wl'^\u) = 1; then (i) wl''\u) = 
1 for all n G {l,...,m} by Remark 6.3(B), (ii) for each n G {l,...,m}, 
*(n,A;,0)(a;) = by (6.2.6) and Remark 2.2(B), hence (iii) 5'^^\uj) = 1 for 
all n G {l,...,m} by (7.1.1) and (7.1.2), and hence (iv) Nk{oj) > m by 
(7.1.5). 

(B) For each m G N, each A; G Z, and each a; G O such that Nk{uj) > m, 
one has that (i) 5j^\uj) G {1,2, ...,6} for all u G {l,...,m} by (7.1.5), 
hence (ii) 5j^\u>) — 1 G {0,1,..., 5} for all u G {l,...,m}, and hence 
(in) J(m, A;) (a;) G {0, 1, 2, . . . , 6"^ - 1} by (7.1.7) and a simple argument. 

Construction 7.3. (A) Refer to Definition 3.3. On the given prob- 
ability space (11,J^,P), let Ck''°"'\ Ci"'''"\ Cfc"''"\ n G N, A; G Z be an 
array of independent random variables, with this array being independent 
of the entire collection of random variables ^{n,k,j), 6^^\ N^, 

J{n, A;), n G N, A; G Z, j G {0, 1, 2, . . .} in Section 6 and Construction 7.1 
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(the redundancy here is for emphasis), such that for each n e N and each 
e Z, (i) all three random vectors Cj^'°^^\ Cj^''^^^\ Ci"^'^"'' take their values 
in the set {-1, i}sxtp(n) ^^^^ (2.1)), and (ii) the distribution of (^("''°'''^) resp. 

^(n.cen) /.(n,fri) . (n) (n) (n) 

Ck resp. Ck IS z^;^^ resp. ly^eA resp. 

(B) For a given n e N, the random vector Ci"'°'^'^'' will be represented 

by 

j-{n,OTd) f >.(n,ord) ^(n,ord) ^(n,ord) \ 

•~ \^k,0 T^k,l ' • • • ' ^fc,sxtp(n)-iy ' 

that is, with the 6" indices running through 0,1,..., 6" — 1 (instead of 
1, 2, . . . , 6"); and exactly the same convention will be used for the random 
vectors (^j^'^^^^ and ci"^'^'^'''- (This fits the convention in Section 3 where, 
for a given n G N, the elements x E { — 1, 1}^^*p("^) were represented as 

X . {xQj X\j • • • , ^sxtp(n) — l)' 

(C) For each n e N and each k e Z, define the ({-1, l}'"'*P("))^-valued 
random vector 

3 2) i^*-"'-' •= ^(^("''^'■'i) ^("icen) ^(n,fri)"^ 

Of course these random vectors are independent and identically distributed. 
For each n e N, define the resulting random sequence C^"^ := (Cfc"\ /e G Z). 

(D) For each n e N and each k e Z, define the ({-1, 1}^)^ x ({-1, 1}36)3 
X ... X ({—1, 1}^''*P("')) ^-valued random vector 

p.3.2) (r-(ci",cf,...,cr')- 

— (n) 

For any given fixed value of n e N, these random vectors (j. , k E Z are 
independent and identically distributed. For each n e N, define the resulting 
random sequence (^^^ :— {Ck^\ k E Z). 

(E) For each k E Z, define the random item (sequence) 



These random items Cfc°°^ , k E Z are independent and identically distributed. 
Define the resulting random sequence ^ :— \ k E Z). 
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(F) Refer to (B) above. Purely as a formality, for each n e N, each 
e Z, and each u e Z — {0, 1, . . . , 6" — 1}, define the constant random 
variables Ck^^^^^ '■= C'Cu'^^^ ■~ Ck^u^^^ :— 1. (This formality will ultimately 
turn out to be frivolous.) 

Construction 7.4. (A) Let X(o) := (xf \ e Z) be a sequence of 
independent, identically distributed {—1, l}-valued random variables such 
that (for each k E Z), 

(7.4.1) P (Xf = -l)=P (4"^ = l) = 1/2, 

with this sequence X^^^ being independent of the entire array of random 
variables Ck^\ Ck^\ n G N, /c G Z (and hence independent of the entire 
collection of random variables in Section 6 and Constructions 7.1 and 7.3). 

(B) Refer to (A) above and to (6.1.4) and (7.3.3). For each k E Z, define 
the random ordered triplet 

(7.4.2) m:={x'°\tr\tr')- 

Note that for any given A; G Z, the three components of rjk are independent 
of each other. These random ordered triplets r]k, k e Z are independent 
and identically distributed. Define the resulting random sequence rj :— {rjk, 
k G Z). 

Construction 7.5. Now on our given probability space {Q,J^,P), 
define the sequence X := (X^, /c G Z) of { — 1, l}-valued random variables 
for Theorem 1.1 as follows: For each A; G Z and each a; G (see Remark 
7.2(B)), 

lxjf\u) iiNk{u)=0 

[l ifiVfe(w)=oo. 

Lemma 7.6. Refer to Constructions 7.4 and 7.5 and Definition 2.6(A). 
The ordered pair (X, rf) satisfies Condition M. . 
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Proof. In what follows, keep in mind the three sentences after (7.4.2). 

For each n e N, the ordered pair {W^'^\r]) satisfies Condition M. by 
(6.1.3), (6.1.4), (6.2.1), and (7.4.2). Hence for each n G N and each j > 0, 
the ordered pair (\E'(n, j), rj) satisfies Condition M. by (6.2.4) (see (6.2.6) and 
the phrase right before (6.2.4)). 

Next, for each n>2 and each A; e Z, 

oo 

wi%in-i,m = E wt-imn - 1, k, 0) = u). 

Hence by (7.1.1), (7.1.2), and both sentences in the preceding paragraph 
above, for each n e N, the ordered pair k e Z),?/) satisfies Condi- 

tion M. 

Next, by (7.1.4), for each k E Z, 
iVfe = ■ 1(4'^ = 0) 



m€N 



m 

n/(4'"#o) ./(*r"=o) 



+ 



Hence by the last sentence of the preceding paragraph, the ordered pair ((AT/-, 
k e Z),//) satisfies Condition M.. Similarly, from (7.1.7), for each m e N, 
the ordered pair {{ J{m, k), k E Z), rf) satisfies condition M.. 

Next, for each £ e N and each /c e Z, by Remark 7.2(B) (see also (2.1)), 

(7.6.1) I{Nu = i) ■ Ctnko),Jii,k) 

oo sxtp(^) — 1 

= E E ^(^'^ = ^) • • nw, k, o) = u). me, k) = v). 

u=0 v=0 

(If a; e J] is such that Nk{(jo) ^ £, then trivially (7.6.1) holds for that a; with 
both sides being 0; for the formal definition of the left side of (7.6.1) for such 
a;, recall Construction 7.3(F) to cover the possible case J(£, k){u>) < 0.) By 
(7.6.1) and the observations made so far, together with equations (7.3.1), 
(7.3.3), and (7.4.2), for each £ e N, the ordered pair 
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satisfies Condition M.. 

Finally, for each e Z, by (7.5.1), 

Xk = ) • I{Nk = 0) + 1 • I{Nk = oo) 

Hence by observations in the preceding two paragraphs together with (7.4.2), 
the ordered pair {X,r]) satisfies Condition M.. Lemma 7.6 is proved. 

Remark 7.7. Of course by Lemma 7.6 (and Definition 2.6(A)), the 
random sequence X is strictly stationary. Also, by (7.4.2), (7.4.1), (7.3.3), 
(7.3.1), and (6.1.4), the random variables rjk, /c G Z in (7.4.2) can be regarded 
as taking their values in the set S := {-1, 1} x {0, l}'^ x {-1, 1}^. Trivially 
that set is bimeasurably isomorphic to the set {0, 1}^, and that set in turn 
is well known to be bimeasurably isomorphic to the open unit interval (0, 1) 
(with its Borel cr-field) and hence also to the real line R (with its Borel a-field 
TZ). Applying a particular bimcasurable isomorphism G : ^ R to each 
of the random variables rjk in (7.4.2), one has that the random sequence 77 
can thereby be "coded" as a sequence of independent, identically distributed 
rea/-valued random variables. Thus by Lemma 7.6, property (C) in Theorem 
1.1 holds. 

The other properties in Theorem 1.1 will be verified in sections 9 and 10, 
after some further preparation in Section 8. The following technical lemma 
will be needed in Section 9. 

Lemma 7.8. For each n e N and each k eZ, P{Nk > n) = (3/8)". 

Proof. For each A; e Z, by (7.1.4) (or (7.1.5)), (7.1.1), and Lemma 
6.4(A) (and stationarity) , 

PiNk > 1) = P(4') ^ 0) = P{wi'^ ^ 0) = 3/8. 

Now for induction, suppose that n e N, A; e Z, and P{Nk > n) = 
(3/8)". If it is shown that P{Nk > n + 1 \ Nk > n) = 3/8, then (since 
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{Nk>n+1}G {Nk > n}) it will follow that P{Nk > n + 1) = (3/8)^+^ 
Then Lemma 7.8 will hold by induction. 

Suppose j G {0, 1, 2, ... } and that P{{Nk > n} n {^'(n, /c, 0) = j}) > 0. 
liu) eflo (see (6.3.1)-(6.3.2)) is such that *(n, k, 0){uj) = j, then wl'^jiuj) = 
1 by (6.2.6) and Definition 2.2 (and statement 6.3(i) and Definition 2.3(A)). 
Also, {Nk >n}e aiW^""^) by (7.1.5), and {*(n,A;,0) = j} e (7(TF^"^) by 
(6.2.6). Hence by (7.1.4) (see the equality in (7.1.5) with m = n and with 
m = n+l), (6.3.2), (7.1.2), and Lemma 6.4(D), 

P{Nk>n + l\ {Nk>n}n {*(n, k,0,) = j}) 

= p (4"+') ^ 1 {iv, > n} n {vi>(n, fc, 0) = j} n = 1}) 
= P {wi'lf^ j^o\{Nk>n}n {*(n, k, 0) = j} n {wi^l) = 1}) 

= 3/8. 

Hence by Remark 2.8, P{Nk > n + 1 \ Nk > n) = 3/8. That completes 
the induction argument and the proof. 

8. Scaffolding (part 3) 

In this section, some more foundations will be laid for the proofs, in 
sections 9 and 10, of the properties in Theorem 1.1 not verified in Remark 
7.7. 

Definition 8.1. Refer to (7.1.4), Section 6.3(A), and Definition 2.3(A). 
For each m e N and each oj E ^Iq, let Emi'^) denote the family of all sets 
E cZ such that the following holds: 

There exist integers j and £ such that 

(8.1.1) j<e, W^'^\u;) = W^'^\u;) = l, and 

W^'^\u;)j^l foraU k e {j + 1, j + 2, ...,£- 1}, 

and 

(8.1.2) E^{ke{jJ + l,...J-l}: Nkito) > m}. 
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(Note that the "inner set" in (8.1.2) contains j but not £.) 

Remark 8.2. (A) Refer to Definition 8.1. Suppose m e N, a; e rio, 
E e 6m{cij), and j and £ are integers such that (8.1.1) and (8.1.2) hold. Since 
Wj"'\uj) = 1 (see (8.1.1)), one has that Nj{uj) > m by Remark 7.2(A)(iv), 
and hence j e E (see (8.1.2)). In fact (for the j in (8.1.1)) 

(8.2.1) j = mmE. 

Thus trivially the set E is nonempty and also (see (8.1.2)) finite. 

(B) For a given m G N, c<; G Oq, and E G Emij^)-, the integers j and £ in 

(8.1.1) are unique, by (8.2.1) and (8.1.1) itself. 

(C) If m G N, a; G Q.q, E G £^^(a;), and also E G £^^(a;), then (see 
section 2.1(D)) either E < E, E = E, or E > E. 

(D) Refer to Definition 8.1 and Section 2.1(H). Suppose m G N and 
Lo G r^o- Then (recall Statement 6.3(A)(i)) 

(8.2.2) {/c G Z : Nk{u;) > m} — union ^^(cj). 

From this and (C) above and a simple argument (recall Statement 6.3(A) (i)), 
(i) one has a representation of the form £m{'^) '■= {■■■■, E_i, Eq, Ei, .. .} 
(the Ei^s depend on m and oj) where (see section 2.1(D)) ... < E_i < 
Eq < El < . . ., and (ii) those sets Ei, i e Z form a partition of the set 
{keZ: iVfc(w) > m}. 

(E) Suppose m G N, G Oo, and E G Sm{uj). (i) If wj^^^H^) = 0' 
then Nk{uj) = m for all k e E. (n) If instead W^^-^\uj) ^ 0, then Nk{u;) > 
m + 1 for all A; G (Note that by (i) and (ii) together, the respective 
converses of (i) and (ii) each hold.) 

Proof of (E). Let the integers j and £ be as in (8.1.1)-(8.1.2). For each 
k G 0-,j + l,...,£-l}, *(m,/c,0)(a;) = k-j by (8.1.1)-(8.1.2), (6.2.6), 
and Definition 2.2, hence j = k — ^{m,k,0){Lij), and hence 6^^'^^\lij) = 
W^"''^^\u;) by (7.1.2). Of course for each k e E, one has that S'j^\io) ^ 
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for all n e {l,...,m} by (8.1.2) and (7.1.4). If ^^'^"^'^(a;) = 0, then for 
all k e 5j^^^\uj) = and hence (see (7.1.4)) Nkiu) = m. If instead 
W^'^^^\uj) ^ 0, then for all k e E, sl!^^^\uj) ^ and hence (see (7.1.4)) 
Nk{i-o) > m + 1. Thus (recall (8.2.1) once more) statement (E)(i)(ii) holds. 

Definition 8.3. (A) Refer to (6.3.1)-(6.3.2) and (7.1.4). For each 
LO G Oq, let 'Do{uj) denote the family of all "singleton" sets {k} (with k E Z) 
such that Nk{uj) = 0. 

(B) For each m e N and each a; e f^o, let T>m{(jo) denote the family of 
all sets E e £m{<^) such that (see Remark 8.2(E)) Nkiu)) = m for all k E E. 

Remark 8.4. (A) Refer to Definition 8.3(B), Remark 8.2(D)(E), and 
section 2.1(H). For each m e N and each a; e flo, 

(8.4.1) {keZ: Nk{uj) = m} = union Vm{uj), 

and in fact the members of Vmioj) form a partition of the set {/c e Z : 
Nk{(jj) = m}. That sentence also holds trivially for m = and oj E flo'i see 
Definition 8.3(A). 

(B) Refer to Remark 8.2(A), Definition 8.3(A)(B), and equations (8.2.2) 
and (8.4.1). (i) For a given u G Oq, none of the families T>„-i{uj) {m > 0) 
or Sm{i^) {jn > 1) contains the empty set as a member, (ii) If a; G fio and 
< m < n, then for any D G T>m{oj) and any E G En{oi}) (in particular, any 
E G X>„(a;)), one has that DnE = ^. 

(C) By (A) and (B) above and Remark 8.2(C) (D), the following holds: 
If m G N and a; G ^o, then the family 

[Vq{oj) U Di(cj) U . . . U Vm-l{0j)] U 8m{0j) 

gives a partition of the set Z itself into countably many nonempty finite sets. 

Lemma 8.5. Suppose m G N, a; G ilo? CLnd E G £m{uj). Then the 
following statements hold: 

(A) One has that cardE = 6"^. 
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(B) Representing the set E by E = {i{l),i{2), . . ., i{6^)} where < 
i{2) < i{3) < ... < i(6""), one has (see (7.1.7)) that J{m,i{v)){u) 

for each v E {1, 2, . . . , 6"^}. 

( C) If also m > 2, then there exist six sets Ei, E2, . . . ,Eq G Sm-i{^^) 
such that El < E2 < . . . < Eq (see Section 2.1(D)) and E = . .UEq. 

Proof. We shall first prove statements (A) and (B) for tlie case m = 1. 
Suppose u; G Oq and E G ^1(0;). 

Let j and £ denote the integers such that (8.1.1) and (8.1.2) hold (with 
m= 1). 

For a given G Z, the following three inequalities are equivalent by 
(7.1.4) and (7.1.1): iVfc(w) > 1, S^,^\uj) ^ 0, and W^^^(w) ^ 0. Hence by 
(8.1.2), 

(8.5.1) E^{ke{j,j + 1,. ..,£-!}: W^'\u;) ^ 0}. 

Since a; G r^o (by hypothesis) , the sequence {Wl^^\uj), keZ) of elements 
of {0, 1, ... , 6} satisfies Condition S (see Statement 6.3(A)(i) and Definition 
2.3(A) again). Hence by (8.1.1), there exist integers z(l),z(2), . . .,z(6) such 
that (see also (8.2.1)) j = i(l) < i{2) < ...< ^(6) < 

(8.5.2) W^^^^-^{u) = v for each v G {1, 2, . . . , 6}, 

and wj^^\uj) = for all other elements G {j, j + 1, . . . , £ — 1}. Hence 
by (8.5.1), E = {i(l),i(2),...,i(6)}. Hence card E ^ 6. Also, by (7.1.7), 
(7.1.1), and (8.5.2), for each v G {1, 2, . . . , 6}, 

J(l,z(^))(a;) = Slll^iu) - 1 = -1 = ^-1- 

All parts of statements (A) and (B) (of Lemma 8.5) have now been verified 
for the case m = 1. 

The induction step. Now suppose M G N, and statements (A) and (B) 
in Lemma 8.5 hold for the case m — M. To complete the proof of Lemma 

66 



8.5 by induction, it suffices to prove that all three statements (A), (B), and 
(C) hold for the case m = M + 1. 

Suppose uj E Qq and E G £^m+i('^)- 

Referring to (8.1.1) and (8.1.2), let j and £ be the integers such that (for 
the given uj and E) 

(8.5.3) j<e, W^^+^\uj) = W^^^^\u;) = 1, and 
wj^^+^\ou)^l foraU k e {j + 1, j + 2, ...,£- 1}, 

and 

(8.5.4) E = {ke{j,j+l,...,e-l}:Nkiuj)>M + 1}. 

By (8.5.3) and Remark 6.3(B), W^^\oj) = W^^\u;) = 1. Let a(0), 
a(l), . . ., a{p) (where p is a positive integer) denote the integers such that 

(8.5.5) j = a(0) < a(l) < a(2) < . . . < a{p) = £ and 
(8.5.6) 

{ke{j,j + l,...,i-l}: W-f (u) = 1} = {a(0), a(l), a(2), . . . , a(p - 1)}. 

Recall that since u> e Qq (by hypothesis), the sequence {wj^^~^^\uj), 
G Z) of elements of {0,1,..., 6} satisfies Condition S (sec statement 
6.3(A) (i) and Definition 2.3(A) again). Hence by (8.5.3), there exist inte- 
gers z(l),i(2), . . .,z(6) with j = < i{2) < ...< i{6) < £ such that 

(8.5.7) (uj) = u for w G {1, 2, . . . , 6} and 

W^^^'^^ (u) = for aU other k E {jj + 1, . . . J - 1}. 

By (8.5.7) and Remark 6.3(B), W^^^\u;) = 1 for each u G {1,2,..., 6}. 
Referring to (8.5.5) and (8.5.6), for each u G {1,2, ...,6}, let e{u) denote 
the element of {0, 1, ... ,p — 1} such that 



(8.5.8) 



i{u) = a{e{u)). 
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Then by (8.5.5), (8.5.8), and the equahty j = just before (8.5.7), one has 
that a(0) = j = = a(e(l)); and hence (sec (8.5.5) and the inequahties 
right before (8.5.7) again) 



(8.5.9) 



= e(l) < e(2) < . . . < e(6) <p-l. 



For each -uG {1,2,. ..,6}, referring to the inequahty a{e{u)) < a{e{u) + 
1) from (8.5.5) (see (8.5.9)), define the set 

(8.5.10) Eu-.^ {keZ: a{e{u)) <k< a{e{u) + 1) and Nk{u;) > M}. 

For each u G {1,2, ...,6}, from (8.5.5) and (8.5.6) (and the sentence right 
after (8.5.4)), one has that W^^J^^^^iu) = W^^J^^^^^^{uj) = 1 and wi''\u) ^ 
1 for aU A; G Z such that a(e(tt)) < k < a{e{u) + 1). Hence by (8.5.10) and 
Definition 8.1 with m = M, 

(8.5.11) E^eSMioj) for each m G (1, 2, . . . , 6}. 

Hence by the induction assumption of Lemma 8.5(A) (B) for the case m = M, 

(8.5.12) card E„ = 6^ for each w G {1, 2, . . . , 6}. 

For each t G {0, 1, . . . ,p — 1} (see (8.5.5) and (8.5.6)), one has the 
foUowing: For each k e Z such that a{t) < k < a{t + 1), '^{M, k,0){uj) = 
k - a{t) by (8.5.5), (8.5.6), (6.2.6), and Definition 2.2, hence a{t) = k - 
*(M,/c,0)(a;), and hence by (7.1.2), 



(8.6.13) 4««>(a,) = = ivi<7"(-)- 



For each w G {1, 2, . . . , 6}, W^„(ei)) (^) = by (8.5.7) and (8.5.8), and 
hence by (8.5.13) (and its entire sentence) one has that 



(8.5.14) 




for all /c G Z such that a{e{u)) < k < a{e{u) + 1). 
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For each u e {1,2, ...,6} and each k e E^, iVfc(a;) > M by (8.5.10), and 
hence iVfc(w) > M + 1 by (8.5.14) and (7.1.4)-(7.1.5). Hence by (8.5.10), for 
each u E {1,2,..., 6}, 
(8.5.15) 

Eu = {keZ: a{e{u)) <k< a{e{u) + 1) and Nk{uj) > M + 1} . 

For any t e {0, 1, . . . ,p - 1} - {e(l), e(2), . . . , e(6)} (see (8.5.8) and its 
entire sentence), one has that j < a{t) < by (8.5.5), a{t) ^ a{e{u)) = i{u) 
for each w e {1, 2, . . . , 6} by (8.5.5) and (8.5.8), and hence Vr^Jf+^^(a;) = 
by (8.5.7). Hence for each t e {0, 1, . . . , p - 1} - {e(l), e(2), . . . , e(6)} and 
each k E Z such that a{t) < k < a{t + 1), one has that 5\!^^^\uj) = by 
(8.5.13) and its entire sentence, and hence Nk{uj) < M by (7.1.4). Hence by 
(8.5.4), (8.5.5), and (8.5.15), the set E has no elements other than the ones 
in the sets E^, tt G {1, 2, . . . , 6}. In fact by (8.5.4) and (8.5.15), one now has 
that 

(8.5.16) E = EiUE2U...UEe, 
and by (8.5.5), (8.5.9), and (8.5.15) (see also (8.5.12)), 

(8.5.17) Ei<E2<...<Ee 
(see section 2.1(D)). Hence by (8.5.12), 

(8.5.18) card£; = 6^+^ 

Thus statement (A) in Lemma 8.5 holds (for the given u) and E) with 
m = M + 1. By (8.5.11), (8.5.16), and (8.5.17), statement (C) in Lemma 8.5 
holds (for the given u and E) with m — M + 1. To complete the induction 
step and the proof of Lemma 8.5, our task now is to verify statement (B) 
(for the given oj and E) with m = M + 1. 

Now refer to (8.5.11) and our induction assumption of statements (A) 
and (B) for the case m — M. For each u E {1,2,..., 6}, referring to (8.5.12), 

69 



representing the set by 

(8.5.19) Eu = {a{u, 1), a{u, 2), a{u, 3), . . . , a{u, 6^)} 

with a{u, 1) < a{u, 2) < . . . < a{u, 6^), 

one has that 

(8.5.20) J(M,a{u,v))(uj) = v-l for all v e {1, 2, . . . , 6^}. 

Referring to (8.5.18), represent the set E by 
(8.5.21) 

E = 1/3(1), /3(2), /3(3), . . . , (3(6^+^)} with /3(1) < /3(2) < . . . < /3(6^+i). 

Then for each w e {1, 2, . . . , 6}, by (8.5.12), (8.5.16), (8.5.17), and (8.5.21), 
the set Eu contains precisely the elements P{6^ {u—l)+v), f e {1, 2, . . . , 6^}. 
Hence by (8.2.19), 
(8.5.22) 

Vwe {1,2,...,6}, Vve {1,2,...,6^}, P{6^{u-l) + v) = a{u,v). 

Now suppose r e {1, 2, . . . , 6^+^}. Let m e {1, 2, . . . , 6} and v e 
{1,2, ...,6^} be such that 

(8.5.23) r = 6^(u-l)+v. 



Then /3(r) e by the sentence preceding (8.5.22), hence a{e{u)) < (3{r) < 
a{e{u) + 1) by (8.5.10), and hence 5^^^1;^\uj) = W^ijf(t}) (u;) =uhy (8.5.14). 
Also, (3{r) = a{u,v) by (8.5.23) and (8.5.22). Hence by (7.1.7) (applied 
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twice) and then (8.5.20) and (8.5.23), 

M+l 

J(M + l,/?(r))(a;) = J] 6^"^ (^^.^(a;) - l) 

M 

=6"-(cr'H-i)+E«'-'«,M-i) 

q=l 

M 

=6-(.-i)+5:6-^ (5ii.)H-i) 

= 6^(u-l) + J{M,a(u,v))(oj) 
= r-l. 

Since r G {1, 2, . . . , G^^"*"^} was arbitrary, one has (see (8.5.21) again) 
that statement (B) in Lemma 8.5 holds (for the given a; and E) with m = 
M + l. That completes the induction step and the proof of Lemma 8.5. 

Definition 8.6. Recall from Definitions 8.1 and 8.3 and Lemma 8.5(A) 
that for each a; e f^o (see (6.3.1)), one has that (i) card £^ = 1 for each 
E e T>o{lij), and (ii) for each m e N and each E e Emi'^) (and in particular, 
for each E e X>m(^)), card E = 6^. Recall also Remarks 8.2(D) (E) and 

8.4(B)(C). 

(A) For each i E {0, 1, 2, ... } and each set -D C Z such that card D — 6^, 
define the set Fd C (see (6.3.1)) as follows: 

(8.6.1) Fd := {uj e no : D e Ve{uj)}. 

(B) For each m e N and each set C Z such that card E = 6'^, define 
the set C flo as follows: 

(8.6.2) Ge := {uj e no :Ee £m{u;)}. 

Remark 8.7. Refer to Lemma 8.5. Suppose m e N, and £■ C Z is a 

set such that card £" = 6"^. 
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(A) The set in (8.6.2) is the set of all a; e fio for which there exist 
integers j and £ such that (8.1.1) and (8.1.2) hold. It follows that Ge is 
an event (that is, a member of the cr-field in our given probability space 
(n,JP,P)); and further, by (7.1.5), 

(8.7.1) Ge eaiW^""^). 

By the same argument, but with the inequality Nk{uj) > m in (8.1.2) replaced 
by Nif{ijj) = m (see Remark 8.2(E) and Definition 8.3(B)), the set Fe in 

(8.6.1) is an event, and by (7.1.6), 

(8.7.2) FEeaiW^""^^^). 

(B) By Definitions 8.1, 8.3(B), and 8.6 (recaU Remark 8.2(E) again), 

(8.7.3) Fe C Ge; 

(8.7.4) y u eFE, y keE, Nk{uj) = m; and 

(8.7.5) y LO gGe- Fe, y k e E, Nk{uj)>m + 1. 

Remark 8.8. Equations (8.7.2) and (8.7.4) hold with m = for any 
singleton set E = {A;} where A; e Z, by (8.6.1), Definition 8.3(A), and (7.1.6). 

Definition 8.9. Refer to Constructions 7.3 and 7.4, to equations 

(6.2.6) , (7.1.4), and (7.1.7), and also particularly to Remark 7.2(B). 

For each n G N, define the sequences Y^"^^ :— {Y^^\ k E Z) and X*^") : = 
{xj^\ /c e Z) of {—1, l}-valued random variables as follows: For each /c e Z 
and each co & Q, 
(8.9.1) 

[4°) (a;) ifiVfe(a;) = 

n^"^(^):= C£*t^^^^ ifiV,(a;)=£e{l,2,...,n-l} 

[ C£'^'(n,fc,0)(c.),J(n,fe)(c.)(^) if ^ ^' 
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and 
(8.9.2) 



4°^M ifiVfc(a;) = 



^'^^M := <! C^'^^"^^ ifiVfc(a;) = £e{l,2,...,n} 

Cfc-S'(l,fc,0)(c.),J(n,fc)(c.)('^) if ^fcl'^) > ^ + 1- 

Of course in the right hand side of (8.9.1), the "middle" case is vacuous (and 
should be omitted) if n = 1. 

Remark 8.10. If A; e Z and D = {k}, then by Remark 8.8 (see equation 
(8.7.4)) and (8.9.1) and (8.9.2), for every oj e Fd, one has that 

(8.10.1) yt\^) = ^k'\^) = ^k\^) for all n e N. 

Lemma 8.11. Suppose m e N, and E G Z is a set such that 

(8.11.1) card^^e"". 

Then in the terminology of (2.3) and (2.4), the following statements hold: 

(A) For every uj e Ge (see (8.6.2)), 

(8.11.2) Yt\u^) = C^:^:f\u^) 
and 

(8.11.3) X^iu) =dr?(a;) • / [w^^^'J = o) (c) 

(B) For every u e Fe (see (8.6.1) and (8.7.3)), 

(8.11.4) ri'^^(c.) = 4'^^(c.) = 4-)(c.) = dr?H foralln>m + l. 

Proof. We shall prove statements (A) and (B) together. 

Suppose OJ E Ge- 
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Then by (8.11.1) and Definition 8.6(B), E e £^^(a;). Referring again to 
(8.11.1), represent the set E by 
(8.11.5) 

= {e(l),e(2),e(3),...,e(6"^)} where e(l) < e(2) < . . . < e(6"^). 

Also, referring to Definition 8.1 and Remark 8.2(B), let j and £ be the integers 
such that (8.1.1) and (8.1.2) hold. We shaU refer freely to (8.1.1) and (8.1.2) 
in the arguments below. By Remark 8.2(A), (8.1.2), and (8.11.5), 

(8.11.6) j = minE = e{l) and ^ > e(6"^). 

For each k e E,hy (8.1.1), (8.1.2), (6.2.6), and Definition 2.2, *(m, k, 0){uj) = 
k-j. Hence by (8.11.5), 

(8.11.7) e {1,2,...,6"*}, j = e{u)-^{m,e{u),0){uj). 
Also, by (8.11.5) and (8.1.2), 

(8.11.8) V « e {1, 2, . . . , 6"^}, 7Ve(«)(a;) > m. 

Proof of (8.11.2). For each w E {1, 2, . . . , 6"^}, by (8.11.8) and (8.9.1), 
followed by (8.11.7), (8.11.5), and Lemma 8.5(B) (recaU also section 7.3(B)), 

11 1^ — /-("^'O^d) / N _ ^(m,ord)/ n 

l^O.ll.y; ^e{u)y'^) ~ ^e{u)-^{m,e{u),0){u}),J{m,e{u)){u})y'^) — ^j,u-l K'^J- 

Hence by (8.11.5) and (8.11.6) (see (2.3), (2.4), and section 7.3(B)), one 
obtains (8.11.2) via 

(8.11.10) ri-)(a;) = C^-'''''\u;) = ^^^'^(a;). 

Proof of (8.11.3). If w'^^e\^) = 0' ^^^en N^^^){uj) = m for aU u e 
{1,2,..., 6"^} by (8.11.5) and Remark 8.2(E)(i), and following the argument 
for (8.11.2) (but using (8.9.2) instead of (8.9.1)), one obtains (8.11.9) and 
(8.11.10) with the letters "Y" and "ord" replaced by "X" and "cen," and in 
this case (8.11.3) holds. If instead W^Tn^s (^) 7^ 0' then A^e(«)('^) > rn + 1 for 
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all ue{l,2,..., 6^} by (8.11.5) and Remark 8.2(E)(ii), and with the same 
argument, one obtains (8.11.9) and (8.11.10) with "y" and "ord" replaced 
by "X" and "fri," and in this case too equation (8.11.3) holds. 

Proof of (8.11.4). Suppose u G Fe (assumed for (8.11.4)). Then 
E e Vmicij) by Definition 8.6(A), and hence A^e(u)(<^) = '"^ for all u e 
{1,2,..., 6^} by (8.11.5) and Definition 8.3(B). Hence by (8.9.1) and (8.9.2) 
(applied twice), for each n> m + 1 and each tt e {1, 2, . . . , 6"^}, 

e(u)^ ' e{u)^ ' 'e(u) — w(m.,e(u),0)(a»), J(m,e(u))(a>) ^ e(u)V / 

Hence (see (8.11.5) again) for each n > m + 1, Y^\u;) = X^\u;) = 
X^\u!). Since A^e(u)(<^) = for '^^ ^ {1) 2, . . . , 6"^} (as was noted 
above), W^^^{u!) = must hold by Remark 8.2(E), and the final equality 
in (8.11.4) now follows from (8.11.3). That completes the proof of Lemma 
8.11. 

Definition 8.12. Suppose n e N. Suppose Q := {Q{1),Q{2), . . . , 
Q{L)} (where L is a positive integer) is a (finite, nonempty) collection of 
(pairwise) disjoint subsets of Z such that 

(8.12.1) cardQ(£) e {l,6,6^6^...,6^} for all £ e {1, 2, . . . , L}. 

(There is no assumption of an "ordering" of these sets; elements of one 
set Q{i) may be between elements of another set Q{j). Also, it is tacitly 
understood that L can be 1, in which case the phrase "(pairwise) disjoint" 
is meaningless and should be omitted.) Define the (possibly empty) set 

(8.12.2) I:=I(n,Q) := e {1, . . . , L} : cardQ(£) = 6"}. 
Define the event H^^'^Q) by (see (8.6.1)-(8.6.2)) 



(8.12.3) 


H^''\Q) := 


n 


n 


n 






e€{i,...,L}-i 







Here (if necessary), define the "vacuous intersection" by n^e0(- ■■)'■= ^ (the 
sample space itself). 
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It is easy to see that this definition of the event H^'^\Q) does not depend 
on the particular order in which the sets in Q are labeled (as Q(^), £ G 
{1,...,L}). 

Lemma 8.13. Suppose n e N. In the context of Definition 8.12, with 
(8.12.1) satisfied and with! and H^''\Q) defined as in (8.12.2) and (8.12.3), 

suppose 

(8.13.1) p(ii'(")(Q)) >0. 
For each £ e {1, 2, ... , L}, define the integer 

(8.13.2) 5(£) :=min Q(£). 

Then the following statements hold: 

(A) One has that H^^'^Q) e aiW^""^). Also, for each uj E H^'^^Q) and 
each £ (ifXis nonempty), = 1. 

(B) Foreachu e H^'^\Q) andeachi G {1,2,...,L} such that card Q{£) = 
1 (and hence Q{£) — {<l{£)}), one has that 

(8.13.3) X^--'\u:) = y(-;(a.) = X(-) (c.) = X^iu^). 

(C) For each u e H'^'^\Q), each m e {1, . . . , n — 1} (ifn >2), and each 
£ e {1, . . . ,L} such that ca.rdQ{£) = 6"", one has that (see (2.3) and (2.4)) 

(D) For any given oj e H^^\Q) and any given £ & I (see (8.12.2)), 
representing the set Q{£) by Q{£) := {^(1), ^(2), . . . , 2(6"")} where z(l) < 
z{2) < . . . < z{6'^) (and hence z{l) = q{£)), and denoting y{u) := z{{u — 1) . 
gn-i _|_ 2) Jqj. ^ g 2, . . . , 6} (and hence y{l) = ^(1) = q{£)), one has (see 
section 2.1(C)) that 

(8.13.5) X(y)(a;) = (ci(,y^'^"^(-), Ci^^'^'^'^l-), Ci(3)'''"^(-)> 
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(with Cfc 
(8.13.6) 
and 

(8.13.7) 



^^'^"■'(a;) := xj^\uj) for all k & Z in the case n = 1), 



(E) Refer to (8.13.1) and (8.12.2). The random variables I{W^1^^^ ^ 
0), £ & X, the random variables k & Z, and the random variables 
^(n,ord)^ ^(n,cen)^ ^(n,fri)^ 77, G N, A; G Z are Conditionally independent given 

the event H^'^\Q). Also, for each£ E X, conditional on H^'^\Q), the random 
variable 7^ 0) takes the value resp. 1 with probability 5/8 resp. 

3/8. 

(F) The random vectors Xq^^-^\ £ e {1, . . . ,L} are conditionally inde- 
pendent given 

(G) The random vectors Yq^ly £ £ {l)---)-^'} conditionally inde- 
pendent given 

(H) The random vectors ^Q^iy £ £ {l,---:-^} o-f^ conditionally inde- 
pendent given 

(I) Refer to (8.12.2), Section 2.5(A)(B), and Definition 3.3. For each 



/n-l) 

(n) 
ord 



[6] 



and 



£eX, one has that (i) C (^qJ^/^ n^''\Q) 
(n) C {yI^% I if(-)(Q)) = C (4% I H^-){Q) 

(J) Recall from Section 2.1(H) the notation union(Q) := Q{1) U Q{2) U 
. . .ug(L). One has that C {y^^^^^^ \ iyH(Q)) = C {x^,^^^^ \ H^-\Q)). 

(K) Suppose S is a nonempty finite subset of Z such that S fl union(Q) 
is nonempty and card(S' fl Q{£)) < 5 for all £ & {1, ... , L}. Then 



£ X 



(n-l) 

Snunion(Q) 



(L) For any nonempty set S C Q(l) U Q{2) U . . . U Q{L), one has that 
(8.13.8) E 

















> E 






\kes J 






\kes J 
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(M) Suppose i el (see (8.12.2)) and S is a set such that Q{£) G S G 
Q(l)ug(2)U...UQ(L). Then 











\kes J 













> E 






+ 720 • 4^(^-1) 




Vfees / 







Proof. Let us first prove statement (A). For each £ e {1, . . . , L} — X, 
letting m{i) G {0, 1, ... , n— 1} denote the integer such that card Q{i) = 6™"*^^) 
(see (8.12.1) and (8.12.2)), one has that Fq(^) e a{W^"'^^^'^^^) C (j(W^"^) 
by (8.7.2) (see section 6.3(E) again). For each £ e I, Gq^^) G a{W^ by 
(8.7.1) (and (8.12.2)). Hence ff(")(Q) e C7(TF^''^) by (8.12.3). Also, for each 
u e H^'^\Q) and each £ e T, one has that oj e Gq(£) by (8.12.3), hence 
Q{i) e Sn{uj) by (8.12.2) and Definition 8.6(B), hence W^'^^^{uj) = 1 by 

(8.13.2) , (8.2.1), and (8.1.1). Both parts of statement (A) have been proved. 
Proof of (B). For each uj e H^'^^Q) and each £ e {1, . . .,L} such that 

cardQ(£) = 1, one has that oj e -Pq(^) by (8.12.2) and (8.12.3), and hence 

(8.13.3) holds by (8.13.2) and (8.10.1) (regardless of whether n = 1 orn > 2). 
Proof of (C). Ifu e H^'^HQ), m e {1,. - 1}, £ e {1,...,L}, and 

cardg(£) = 6"^, then uj e Fq^^) by (8.12.2) and (8.12.3), and hence (8.13.4) 
holds by (8.13.2) and (8.11.4) (regardless of whether n — 1 = m or n — 1 > m). 

Proof of (D). Suppose uj e H^''\Q) and £ e X. Then u e Gq(^) by 
(8.12.3). Referring to (8.13.2), one can apply (8.11.2) and (8.11.3) with 
m = n (see (8.11.1) and (8.12.2)), and thereby one obtains (8.13.6) and 
(8.13.7). The remaining task is to prove (8.13.5). 

If n = 1, and hence caxdQ{£) = 6, then in the terminology of statement 
(D), Q{£) := {^(1),^(2),...,^(6)} where ^(1) < z{2) < ... < ^(6), also 
y{u) = z{u) for each tt e {1, . . . , 6} (and q{£) = y{l) = z{l)), hence 
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and thus (8.13.5) holds (see the phrase right after (8.13.5)). 

Now suppose instead that n > 2. Recall again from (8.12.3) that oj e 
Gq^I) (since £ G X). By (8.6.2), Q(£) e £n{i^)- Hence by (8.1.2), 

(8.13.10) ykeQie), Nk{uj)>n. 

Applying Lemma 8.5(C) (with m = n), let £^(1), E{2), . . . , E{6) be sets C Z 
such that E{1) U E{2) U . . . U E{6) = Q{i), E{1) < E{2) < ... < E{6), 
and E{u) e £„_i(a;) for each u G {1,...,6}. For each u G {1,...,6}, 
card E{u) = 6"'~^ by Lemma 8.5(A) (applied with m = n — 1). It follows 
that in the terminology of statement (D) (here in Lemma 8.13), for each 

ue{l,...,6}, 

E{u) = {z{{u - 1) • 6"-i + 1), z{{u - 1) • 6^-1 + 2),...,z{u- 6^-^)} , 

and hence also min E{u) = y{u) (recall also that y(l) = q{£)). Also (see 
section 2.1(C)) 

For each tt G {1, . . . , 6}, since E{u) G £^n-i(<^) (as was noted above), one has 
by (8.13.10) and Remark 8.2(E) that wj^'^l^iu) ^ must hold, and hence 
by (8.11.3), X^j^~^\uj) = cl'l'^^'^'^Huj)- Equation (8.13.5) follows. That 
completes the proof of statement (D). 

Proof of (E). By statement (A), iyH(Q) = iyH(Q) DiaeilW^iJ) = 
1}]. Hence by ((8.13.1) and) Lemma 6.4(D), conditional on the event /f(")(Q), 
the {0, l}-valued random variables liw'^^^^ 0), ^ G X are independent, 
with each taking the value resp. 1 with probability 5/8 resp. 3.8. Also, the 
random sequences C*^°°\ ^ind X^^^ are independent by Constructions 

7.3 and 7.4; and hence the random sequences w'^^^^\ c''°°\ and X^^^ are in- 
dependent by (6.2.1) (and Definition 2.6). Also, the random variables X^\ 
/c G Z and Ci"'°'''^\ Ck''''^''\ and C'k'^''\ n G N, G Z are all independent of 
each other, by Constructions 7.3(A) and 7.4(A). Putting these pieces (and 
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the first sentence of statement (A)) together, one obtains statement (E) by 
an awkward but trivial calculation involving conditional probabilities. 

Proof of (F), ( G), and (H). We shall just give the argument for (H). The 
arguments for (F) and (G) are similar, using (8.13.5) resp. (8.13.6) in the 
places where (in the argument below for (H)) (8.13.7) is used. (Keep in mind 
that here in our context of Definition 8.1.2, the sets Q{t}^ I G {1, 2, . . . , L} 
are (pairwise) disjoint (if L > 2).) 

Define the random variables (vectors) Z^, £ G {1, . . . , L} as follows: For 
ijJ G Ho, 
(8.13.11) 

:%{oo) ifcardg(£) = l 

I ^g(^) "^('^) if card Q{t) = 6^ where m G {1, . . . , n - 1} 

[ [RHS of (8.13.7)] if£GJ 

(Of course in the right hand side of (8.13.11), the "middle" part is vacuous, 
and should be omitted, if n = 1.) 

By statement (E) (and the trivial fact that liW^^^f^^^ = 0) = 1 - 
I{wj^^^^^ 7^ 0) ^ ^ 2r), the random variables Zi, Z2, . . . , Zl are condi- 
tionally independent given Jf('^)(Q). Also, by (8.13.3), (8.13.4), (8.13.7), and 
(8.13.11), ^Q(^^)(a;) = Zi{u)) for each u) G H^'^^Q) and each ^ G {1, . . . , L}. 
Hence (see section 2.5(A)) 



-y{n) -y{n) 
^Q(1)'^Q(2)' 



H^'^XQ)) = C ((Zi, Z2, . . . , Zl) I h^'^Xq)) 



C {Zi I H^'^\Q)^ X ... X £ (^Zi I H^''\Q)^ 



X 



-in) 
'Q{L) 



Thus (H) holds. 

Proof of (I). Suppose £ G X. Recall the first sentence in statement 
(A), and recall from the proof of (E) that the random sequences W^^~^^\ 
C^°°\ and are independent of each other. By Construction 7.3(A) and 
equation (8.13.5) (see also Section 2.5 (A) (B)), 



.(n-l) 



ifH(Q)) = C (jRRS of (8.13.5)] H^'^^Q) 

= £([RHS of (8.13.5)]) = (4""'^)^" • 
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Thus statement (i) in (I) holds. The equahty | H(''\Q)) = in 

statement (ii) holds by a similar argument using (8.13.6) instead of (8.13.5). 
To obtain the final equality in statement (ii), note that for any 
a G {-l,l}s^tp('^) (see (2.1)), by (8.13.7), statement (E), the first sentence 
of (A), Construction 7.3(A), and Remark 3.4, 



P X 



-in) 



'{n) 



= (5/8) • P (C, 



(n,cen) 



W 



(n+l) 



0^ n 



+ (3/8) • P (Ci(,f = a I [W^-^'^ ^ O} n H(-\Q)) 
= (5/8) • P (Cjjp) = a) + (3/8) 
= (5/8)-^^(Sl(W) + (3/8)-4i^(W) 



{{a}). 



Thus the last equality in statement (ii) in (I) holds. That completes the 
proof of statement (I). 

Proof of (J). Recall again that the sets Q{£)., £ G {1, 2, . . . , L} are (pair- 
wise) disjoint (if L > 2). By statements (B), (C), and I(ii), 

for each £ e {1,...,L}. Hence statement (J) holds by statements (G) 
and (H). 

Proof of (K). By statements (F) and (G), it suffices to prove that for 
each £ G {1, . . . , L} such that S fl Q{£) is nonempty, one has that (see (2.4) 
and section 2.5(A) again) 



'(n-l) 

'SnQ(^) 



Jf(-)(Q) 



(n) 



Sf^Q{l) 



For £ ^ T (see (8.12.2)), that holds trivially by (8.13.3) and (8.13.4). For 
£ G X, it holds by statement (I)(i)(ii), Lemma 3.7(A), and the assumption 
(in statement (K)) that card(5 n Q{£)) < 5. Thus (K) holds. 
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Proof of (L) and (M). First just suppose S' is a nonempty subset of 
Q(l) U Q(2) U . . . U Q{L). For a given vector A;(2), . . . , fc(6)) e 

(the coordinates need not be distinct), if the set K := {^(1), ^(2), . . . , A;(6)} 
intersects at least two of the sets Q{1) (and hence card(iir n Q(£)) < 5 for 
each £ e {!,..., L}), then by statements (F), (G), and (K), 



(8.13.12) 



E 



.u=l 



E 



n 



k{u) 



.u=l 



Also, by (8.13.3) and (8.13.4), equation (8.13.12) holds if /c(l), . . . , A;(6) are 
elements of the same set Q{£) where £ ^X. Hence the two sides of (8.13.12) 
can differ only in (some) cases where /c(l), . . . , /c(6) are elements of the same 
set Q{i) where £ e J. Hence, using the notation T t Q := T xT xT xT xT xT 
for a given set T, one has that 



(8.13.13) 

E 



k€S 



(n-1) 



E 



Kk€S 



(n) 



([LHS of (8.13.12)] - [RHS of (8.13.12)]) 

(fc(l),...,fe(6))G5T6 

Y Y ([^^^ (8.13.12)] - [RHS of (8.13.12)]) 



^ex (fe(i),...,fe(6))e(SnQ(^))T6 



= E 



E 



{ 



E 

\k&Sr\Q{e) 



(n-1) 







)■ 













E 










. \keSnQ{£) J 







Hence by statement I(i)(ii) and Lemma 3.7(B), equation (8.13.8) holds. Now 
if also S D Q{i) for some £ e T, then by (8.13.13), statement I(i)(ii), and 
Lemma 3.7(B)(C), equation (8.13.9) holds. That completes the proofs of (L) 
and (M) and of Lemma 8.13. 

Definition 8.14. Suppose is a nonempty finite subset of Z, and 
n is a positive integer. A "class C{n) covering of S" is a family Q :— 
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{Q{1),Q{2), . . . , Q{L)} of finitely many subsets of Z (where L is the number 
of sets in the family Q) with the following four properties: 

(i) For each £ G {1, . . . , L}, card Q{i) E {1, 6, 6^, . . . , 6""}. 

(ii) The sets (5(1), Q (2), ... , Q{L) are (pairwise) disjoint (if L > 2). 

(iii) 5cg(i)ug(2)u...ug(L). 

(iv) For each £ e {1, . . . , L}, the set S r\Q{£) is nonempty. 

Lemma 8.15. Suppose S is a nonempty finite subset ofZ, n is a positive 
integer, and uj & Qq. Then there exists exactly one class C{n) covering Q 
of S such that (see (8.12.2)-(8.12.3)) u e H^''\Q). That covering Q is the 
family of all sets 

D e [Vo{uj) U Pi(a;) U . . . U Vn-i{uj)] U £n{uj) 

such that the set D n S is nonempty. 

Proof. Suppose S, n and uj are as in the statement of Lemma 8.15. 
Referring to Definitions 8.1 and 8.3, define the family Vn of subsets of Z by 

(8.15.1) Vn := [l^o(a;)UPi(a;)U...UP„_i(a;)]U£:„(a;). 

Then by Remark 8.4(C), Vn is a partition of the set Z itself into countably 
many nonempty finite sets. 

Let Q* denote the family of all sets D G Vn such that the set D r\ S 
is nonempty. Since the set 5" is finite and the members of Vn (and hence of 
Q*) are (pairwise) disjoint, the family Q* has only finitely many sets. By 
(8.15.1), Lemma 8.5(A), and Definition 8.3(A)(B), the family Q* satisfies 
property (i) in Definition 8.14. Properties (ii), (iii), and (iv) in Definition 
8.14 hold for Q* as trivial consequences of the definition of Q* and the fact 
that V^ is a partition of Z. Thus Q* is (by Definition 8.14) a class C(n) 
covering of S. 

Our next task is to show that uj G H^'^\Q*). Refer to property (i) in 
Definition 8.14 and refer to Lemma 8.5(A) again. For each m G {0, 1, ... , 

n — 1} and each D E Q* such that card-D = 6"^, one must have that D G 
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Vm{uj) by (8.15.1) (since D e Vn but D cannot belong to Vy_{uj) or even 
8u{^) for any u ^ mhy Lemma 8.5(A)), and hence to e Fd by (8.6.1). For 
each D E Q* such that card L> = 6", one similarly has that D G 8n{ijj) 
by (8.15.1) and hence G by (8.6.2). Hence by (8.12.2)-(8.12.3), u G 
iy(")(Q*) (which is simply the intersection of the various events Fd and Gd 
mentioned above). 

By the definition of Q* and its properties identified above, all of Lemma 
8.15 has been proved except for uniqueness. 

Suppose Q is any class C{n) covering of the set S such that uj G H'^^^Q). 
To prove uniqueness in Lemma 8.15, our task is to show that Q= Q* . Refer 
again to property (i) in Definition 8.14. For each m G {0, 1, . . . , n — 1} 
and each D & Q such that cardD = 6"^, one has that to G Fd (since 
H^^\Q) C Fd by (8.12.2)-(8.12.3)), hence D G V^{uo) by (8.6.1), hence 
D G Vn by (8.15.1). For each D E Q such that cardD = 6"^, one similarly 
has that oj E Go (again by (8.12.2)-(8.12.3)), hence D G £n{uj) by (8.6.2), 
hence D eVn^y (8.15.1). Hence Q C Vn- 

U D eVn and the set Dn5' is empty, then (by property (iv) in Definition 
8.14)) D cannot belong to Q. If D G Vn and (instead) the set D D S is 
nonempty, then (by property (iii) in Definition 8.14), D must belong to Q 
(since no other set in Vn will contain a given k G DOS). Hence Q = Q* 
(by the definition of Q*). That completes the proof of uniqueness, and of 
Lemma 8.15. 

Lemma 8.16. Suppose n G N. Then the following four statements hold: 

(A) The random sequences y(") and have the same distribution 
(on {-1,1}^). 

(B) For any nonempty set 5" C Z such that card 5 < 5, the ran- 
dom vectors Xg^ and Yg^^ (see (2.4)) have the same distribution (on 

(C) For any nonempty finite set S <Z 7i, Ei^keS -^k^ ^^)^ — 
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(D) For any integer m > 6 • 16"', 

(m \ 6 / m \ 6 

^^(n-i)j >£;fj]rf)j +360-46(-i). 

Proof. Before addressing any of the four statements (A) — (D) in 
Lemma 8.16, let us present some arguments that will be common to the 
proofs of all four statements. 

Let n G N be arbitrary but fixed. 

Suppose 5 is a nonempty finite subset of Z. 

Since there are only countably many finite subsets of Z, there exist only 
countably many finite families of finite subsets of Z, and hence (see Definition 
8.14) only countably many class C{n) coverings Q of S. For each such Q, 
H^'^^Q) C Oo (again see (6.3.1)-(6.3.2)) by (8.6.1), (8.6.2), and (8.12.2)- 
(8.12.3). By Lemma 8.15, the events H^'^\Q), for class C{n) coverings Q of 
S', form a countable partition of fio- (Some of those events H^'^\Q) may be 
empty.) 

In the sums below, the index Q ranges over all class C{n) coverings of 
S such that P{H^'^\Q)) > 0. By a simple argument (see section 2.5(A) and 
equation (2.4)), 

(8.16.1) C (^fJ"^) =5^^ (jt^ I ^^"^2)) ■ P (^^"^2)) , 

Q 

and the analogous statements holds with Yg^^ replaced by Xg^ and by 

Yin) 

For each such covering Q (with P(ff(")(Q)) > 0), one has that >C(Y'j"^ | 
iyW(Q)) = £(X^") I iyW(Q)) by Lemma 8.13(J) and property (in) in 
Definition 8.14. Hence by (8.16.1) and its analog for one has that 

£(yj")) = £{X^^^). Since S was an arbitrary nonempty finite subset of Z, 
statement (A) in Lemma 8.16 follows. 

Next, in the case where cards' < 5, an exactly analogous argument 
holds with Xg^"* replaced by Xg^~^\ using Lemma 8.13(K). Thus statement 
(B) in Lemma 8.16 holds. 
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Next (regardless of the (finite) cardinafity of S), 
(8.16.2) 

/ \kes / 

iy(")(Q) 




■P{H^'^\Q)). 



Hence by Lemma 8.13(L), statement (C) in Lemma 8.16 holds. 

Proof of statement (D). Suppose (for our given n e N) that m > 6 • 16*^. 
Now let S := {1,2, ...,m}. 

Let B denote the set (event) of all a; e fio such that there exist distinct 
integers z, j e {1, 2, . . . , 6 • 16^} such that ^^^""^(0;) = w'f'\uj) = 1. 

Suppose u & B. Then by Definition 8.1 and a trivial argument, there 
exists a set £^ e £ni^^) such that E C {1, 2, . . . , 6 • 16"} (and hence E C 
{1, 2, . . . , m}). Now card = 6" by Lemma 8.5(A). Also, by Lemma 8.15, 
£^ is a member of the unique class C{n) covering Q of {1, 2, ... , m} such that 
oj e iy(^)(Q). 

Hence B C Uq^j H^'^\Q) where J denotes the family of all class C{n) 
coverings Q of {1,2, ...,m} such that Q contains at least one member E 
such that E C {1,2,..., m} and card E = 6^. Let J'+ denote the family 
of all Q G J' such that P{H^'^\Q)) > 0. Now by Lemma 6.7, P{B) > 1/2. 
Hence ^q^j^ P{H(^\Q)) > 1/2. 

Now by (8.16.2), together with Lemma 8.13(M) (for Q e J+) and 
Lemma 8.13(L) (for the other Q's such that P(ff(")(Q)) > 0), 

[LHS of (8.16.2)] > 720-4^(^-^) •P(iy^"^(Q)) > 360-4^("-^\ 

Thus statement (D) in Lemma 8.16 holds. That completes the proof. 

Lemma 8.17. (A) For every n G N and every nonempty set S G Z with 
cards' < 5, one has that (see (2.4) and section 2.5(A)) 
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(B) If m and N are positive integers such that m > 6 • 16^, then for 
every n> N , 



Proof. Statement (A) follows from Lemma 8.16(A) (B) and induction. 

Proof of (B). Suppose m and N are as in statement (B). Refer to Con- 
struction 7.4(A). Obviously E{X^^'^Y = 1 resp. if £ is an even resp. odd 
integer. Hence by a well known, elementary calculation (the "6th moment" 
analog of the argument, involving 4th moments, in [1, proof of Theorem 
6.1]), one that ^^(EfcLi ^k^)^ ^ l^m^. Also, by Lemma 8.16 (A)(C), the se- 
quence of numbers -^(J^^j^ xj^^)^, n e {0, 1, 2, . . . } is nonincreasing. Also, 
by Lemma 8.16(A) (D), 



Combining these three preceding sentences, one obtains statement (B) in 
Lemma 8.17. 

9. Proof of properties (A), (B), (E), and (F) in Theorem 1.1 

This section contains arguments somewhat reminiscent of ones in [6]; 
but because of some nontrivial differences, the arguments here will be given 



By Lemma 7.6 and Remark 7.7, the random sequence X := (X^, A; e Z) 
defined in (7.5.1) satisfies strict stationarity and Property (C) in Theorem 
1.1. Here in Section 9, it will be shown that the sequence X satisfies prop- 
erties (A), (B), (E), and (F) in Theorem 1.1. Finally in Section 10, property 
(D) (the triviality of the double tail d-field) will be verified, and the proof of 
Theorem 1.1 will then be complete. 

We start with some preliminary arguments. By (7.5.1), (8.9.1), (8.9.2), 
and Constructions 7.3 and 7.4, the random variables X^, xj^^\ Y^'^\ 

/c G Z, n G N all take their values in the set { — 1, 1}. 



E 





in full. 
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For each A; e Z, P{Nk = oo) = by Lemma 7.8. For each k e Z 
and each oj e fl such that A^fe(<^) < oo, one has by (7.5.1) and (8.9.2) that 
Xk{uj) = Xl''\uj) for all n > Nk{uj). Thus trivially, 

(9.1) V/ceZ, Xl'''^ ^ Xk a.s. asn^oo. 

Now let us prove properties (A), (B), (E), and (F) in Theorem 1.1. 

Proof of (A) and (B). Suppose S is any nonempty subset of Z such that 
cards' < 5. By (9.1) (see also (2.4)), Xg^^ — > Xg a.s. as n ^ oo. As an 
elementary consequence, X^g^ =j> Xg (convergence in distribution) as n ^ 
oo. Hence by Lemma 8.17(A) (see also Section 2.5(A)), C{Xs) = C{xf^). 

That last equality has two consequences: First, taking 5" = {k} for an 
arbitrary /c e Z and applying (7.4.1), one obtains property (A) in Theo- 
rem 1.1. Second, taking arbitrary subsets S C Z with cardS = 5, and 
applying the independence of the ^^^'''s in Construction 7.4(A), one obtains 
property (B) in Theorem 1.1. 

Proof of property (E). We shall now use the notations in (1.1). Let M 
be an arbitrary but fixed integer such that M > 96. To prove property (E), 
it suflBces to show that 

(9.2) E \m-^/'^S{X, M)] ^ < 15 - 16"^. 
Let N be the positive integer such that 

(9.3) 6- 16^ < M < 6- 16^+^ 
By (9.2) and Lemma 8.17(B), 

(9.4) yn>N, £; S(X("\M)]^ < 15M3- 360 -4^(^-1). 

Now for each n e N, [S{X^''\M)f < (since each X^"^ takes its 
values in {—1, 1}). Also, as a trivial consequence of (9.1), [S{X^'^\ M)]^ 
[S{X, M)]^ a.s. as n — > oo. Hence by dominated convergence, E[S{X^'^\ M)]^ 

88 



^ E[S{X,M)f as n ^ oo. Hence by (9.4), E[S{X,M)f < [RHS of (9.4)]. 
Dividing both sides of this by and then applying the second inequahty 
in (9.3) and simple arithmetic, one obtains 

[LHS of (9.2)] < 15 - 360 • A^^^'^^M^ 

< 15 - [360 ■ 162^^-^V[216 • 16^(^+^)] = 15 - (360/216) • 16"^ 

Thus (9.2) holds, and property (E) is proved. 

Proof of property (F). This is analogous to a corresponding argument in 
[6]. However, it is short and is also at the core of this construction. It will 
be given in full here. 

By property (A) (proved above), EXq = and EX^ = EX^ = 1. 
Hence by strict stationarity, property (B), and the well known, elementary 
calculation in [1, proof of Theorem 6.1] (which requires only 4-tuplewise 
independence), one has that for each n G N (again see (1.1)), 

(9.5) E = 0, 

(9.6) E (n-^/'^SnY ^l, and 

(9.7) E (n-^/^Sr,y <3. 

By (say) (9.6) and Chebyshev's inequality, the family of distributions of the 
normalized partial sums (n~^/^5'„, n E N) is tight. 

Now for the proof of property (F), suppose Q is an infinite subset of N. 
Because of tightness, there exists an infinite set T C Q and a probability 
measure fi on (R, TZ) (both T and /j, henceforth fixed) such that 

(9.8) rT^/'^Sn =^ A* as n ^ oo, n e T. 

To complete the proof of property (F), our task is to show that ji is neither 
degenerate nor normal. 
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Because of (9.7), (9.8), and [1, p. 338, the Corollary], one has by (9.5) 
and (9.6) that 

(9.9) / xii{dx) = and / x^n{dx) = 1. 

Hence the probability measure ji has positive variance and is therefore non- 
degenerate. Our task now is to prove that /x is not normal. 

If were normal, then by (9.9) it would have to be the A^(0, 1) distribu- 
tion, and hence by a well known calculation (e.g. [1, p. 275, Example 21.1]) 
one would have j^^^x^ ii{dx) = 15. By (9.8) and [1, p. 334, Corollary 1, and 
p. 338, Theorem 25.11], one would then have 

liminfE (n-^/^SnY > 15. 

But that contradicts property (E) (proved above). Hence fi cannot be nor- 
mal. That completes the proof of property (F). 

10. Proof of property (D) in Theorem 1.1 

This is the final piece in the proof of Theorem 1.1. This argument will 
be divided into thirteen "steps" (including some "lemmas"), numbered 10.1, 
10.2, etc. 

Step 10.1. Let F' be an arbitrary but fixed event such that 

(10.1.1) F' e %ouUeiX). 

To prove property (D), i.e. to show that '?doubie(-^) is trivial, our task is to 
show that P{F') = or 1. 
Suppose instead that 

(10.1.2) < P(F') < 1. 



Our task is to produce a contradiction. That task will consume the rest of 
Section 10 here. 
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Step 10.2. By the assumption of (10.1.2), one has that [-P(-F')]^ < 
P{F'). Let e e (0, 1) be fixed such that 

(10.2.1) [P(F') + e] ■ [P{F') + 3e] < P{F') - 4e. 

By (10.1.1), (7.4.2) (and its entire paragraph), (7.5.1), Lemma 7.6, and 
Definition 2.6, one trivially has that F' e cr(X) C a{r)). (One can do better, 
but this will suffice.) Hence from Constructions 6.1, 7.3, and 7.4 and a stan- 
dard measure-theoretic argument (again see (7.4.2)), there exists a positive 
integer N' and an event 

(10.2.2) F" e a (xl^\ -N' < k < N'^ 

ya{^lr\ l<n<N', - 
Va(cf\ l<n<N',- 

(see (7.3.1)) such that 

(10.2.3) P{F"AF')<e 

(where A denotes symmetric diflFerence). 
By (10.2.3) and a trivial argument, 

(10.2.4) P{F") < P{F') + e. 
Increasing N' if necessary, assume further that 

(10.2.5) iV' > 1 + 6 • (8/5)^° • (8/3)^ 

(The positive integer N' and the event F", satisfying (10.2.2)-(10.2.5), are 
now taken as "fixed.") 

Step 10.3. Refer to section 6.3(A). Random variables defined in this 
step will be defined on VLq and left undefined on VLq. 
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-N' <k<N'^ 
-iV' <k<N'^ 



For each n e N, we shall define a random positive integer L„ and 
a sequence {H{n, 1), H{n, 2), H{n, 3), . . .) of random positive integers such 
that for each a; G Oq, 

(10.3.1) Ln{u) < H{n, < H{n, 2){u) < H{n, < . . . 
and 

(10.3.2) {keZ:k> Ln{uj) and wl^'"\uu) = l} 

= {H{n, H{n, 2){u), H{n, 3){uj), . . .}, 

and also (see section 6.1(C)) 

(10.3.3) a(L„, H{n, 1), H{N, 2), H{n, 3),...)ta (?^"^) . 
This will be done in such a way that 

(10.3.4) ELi <N' + 6- (8/5)^° • (8/3)^ 

Also, for each n > 2, we shall define a random positive integer satisfying 

(10.3.5) a{^n) C a (l^""^^ and E^^ < 6 • (8/5)^0 . (8/3)^ 

The definition will be recursive, and is as follows: 

To start with n = 1, refer to Statement 6.3(A)(ii) (and Section 
2.4(A) (B)(C)(D)). Define the positive integer- valued random variable Li as 
follows: For every a; e fio, 

(10.3.6) Li{io) := min{A; e Z : A; > iV' + 6 and [^k-l{io) \ C^-liu;) \ 

■■■\m-)]=Ie} 

(where as usual, the superscript t denotes transpose). By Lemma 5.2(C) (see 
Section 6.1(B)), equation (10.3.4) holds. Now define the random positive 
integers H{l,i), i G N uniquely by (10.3.1) and (10.3.2) (for n — 1) for 
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uj e no. Trivially by (10.3.6), (10.3.1)-(10.3.2), and (6.2.1) (and Remark 
2.6(B)), equation (10.3.3) holds for n = 1. 

Now suppose n > 2, and the positive integer-valued random variables 
Ln-i and H(n — l,i), i G N are already defined, satisfying (10.3.1), (10.3.2), 
and (10.3.3) with n replaced by n — 1. 

Referring to (10.3.1)-(10.3.2) and Statement 6.3(A)(iu) (with n replaced 
by n — 1), define the positive integer- valued random variable as follows: 
For each u E Qq, 



(10.3.7) $„(c.) := min{k > 6 : [4t-i,fe-5)M(^) I 4t-i,.-4)M(^) 



Next, define the positive integer- valued random variable L„ as follows: For 
all u! e Qq, 



Now define the random positive integers H[n, i), i £ N (uniquely) by (10.3.1) 
and (10.3.2) (for the given n) for a; e JIq- 

By (10.3.3) (with n replaced by n — 1) and (10.3.7) (for the given n), 
the first part ((t($„) C aif""^)) of (10.3.5) holds; hence by (10.3.3) (with 

— (n) 

n replaced by n — 1) and (10.3.8) (for the given n), cr{Ln) C cr(^ ); and 
hence (10.3.3) holds for the given n by (10.3.1)-(10.3.2) and (6.2.1). To 
complete this recursive definition, all that remains is to verify the second 
part {E^n < ...) in (10.3.5). 

For that purpose, we shall apply Lemma 5.2(D), with the random inte- 
gers k(j), i e Z there defined by k(j) := H{n — 1, j) for j > 1 and (just as 
a frivolous formality) k(j) := j (a constant random variable) for j < (see 
(10.3.1)). Then cr{K{j)), j G Z) C cr{f~^^) by (10.3.3) with n replaced by 
n — 1. Since the sequences ^'^"^ and are independent (and has 

the appropriate distribution), all conclusions of Lemma 5.2(D) apply to the 
sequence 

(^in, i e Z). Applying Lemma 5.2(D) (iv) to that sequence, one 




(10.3.8) 



Ln{u;) := H{n - 1, $n(a;))(a;). 



93 



obtains that the random variable (see (10.3.7)) satisfies the second part 
of (10.3.5). That completes this recursive definition. 

By (10.3.6), (10.3.1), (10.3.7) (which gives <5n{uj) > 6 for n > 2 and 
u> e Hq), (10.3.8), and induction, one has that for all u) e Qq, 

(10.3.9) N' + 6< Li{uj) < H{1, l){uj) < L2{uj) < H{2, l)(w) 

<L3(a;) <iy(3,l)(a;) < ... . 

Step 10.4. The "universe" of "scaffolding" in Sections 6, 7, and 8 was 
based on the following array of independent random variables from Con- 
structions 6.1, 7.3 (recaU (7.3.1)), and 7.4: 

(10.4.1) Xf , /ceZ; andei"\cl"'°'''\ci"''''^\cl"'''^^ (n, /c) e N x Z. 

Here in Step 10.4, we shall construct an "alternate universe" based on an 

array 

(10.4.2) 

-t^*(0) 1 ^ rr 1 ^*(n,ord) ^*(n,cen) j-*(n,fri) / ; \ ^ tvt rr 

Xf}\keZ- and Cfc^ ^Cfc ,Cfc ,Cfc ^(n,A;)eNxZ. 

To create this "alternate universe," we shall keep the "original" random 
variables in the array (10.4.1), except that the random variables in (10.4.1) 
that are mentioned in the right hand side of (10.2.2) will be replaced by 
"independent copies." 

(A) Refer to the positive integer N' in (10.2.2) and (10.2.5). Let 

(10.4.3) k e {-N', -N' + 1, -N' + 2, . . . , AT'} and 

>-*(n) ^*(n,ord) ^*(n,cen) j-*(n,fri) 
^^k i^k i^k ' 

ne {l,2,...,iV'}, k e {-N',-N' + 1,...,N'} 

be an array of independent random variables, with this array being inde- 
pendent of the entire array (10.4.1) (and hence independent of the entire 
collection of random variables studied in sections 6, 7, 8, and 9), such that 
for each k e {-N', -N' + 1, . . . , N'} and n e {1,2,..., A^'}, the random 
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• T_i TA*(0) ^*(n) j-*(n,ord) j-*(n,cen) j-*(n,tri) , ^ ., 

variable ' resp. ' resp. C/, resp. ' resp. C/, takes its 

values in the space { — 1, 1} resp. {0, 1}^ resp. {—1, i|sxtp(n) ^g^^ ^2.1) again) 
resp. { — 1, l}^^tp(") resp. {—1, l}*^^tp(") and has the same distribution as the 
random variable xj^^ resp. ^j^^ resp. Ci"'°'^'^'* resp. (^j^'^'^"^^ resp. Cfc"^'*'^'''. 

(B) For each keZ- {-N', -N' + 1, . . . , N'}, define the {-1, l}-valued 
random variable by := ^ (that is, for aU u; E X*^°^(a;) := 

(C) For each (n, A;) G (Nx Z)-({1, 2, . . . , A^'} x {-A^', -A^'+l, . . . , A^'}), 
define the {0, l}^-valued random variable by := Ck^\ and define 
the {-1, Ij^'^^P^'^^-valued random variables (see (2.1)) Ck^'^'°'"^\ Cfc^"'*^^"\ and 



^*(n,fri) 1 **(n,ord) ^(n,ord) ^*(n,cen) ^(n,cen) , ^*(n,fri) 

''A; ■— ' ''fe •— ^k ' ''fc •— ^k 



That completes the definition of the array (10.4.2). 

(D) Recall from Constructions 6.1, 7.3, and 7.4 that the random vari- 
ables in the array (10.4.1) are independent of each other. It follows from 
the conditions in (A), (B), and (C) above that the random variables in the 
array (10.4.2) are independent of each other, and that in fact the two arrays 
(10.4.1) and (10.4.2) have the same distribution (on the appropriate space). 

(E) Further, the array (10.4.2) is independent of the entire cr-field in 
the right hand side of (10.2.2). Hence by (10.2.2) itself, 

(10.4.4) the event F" is independent of the array (10.4.2). 

(F) Starting with (A), (B), (C), and (D) above, we construct analogs 
of all of the random variables constructed in Sections 6, 7, and 8, using the 
array (10.4.2) in place of the array (10.4.1). The notations will be the same 
except that (as in (10.4.2)) an asterisk will be inserted after each "main 
symbol." The general pattern is that for a given random variable Z of 
the form Z := /(the array (10.4.1)), where / is an appropriate measurable 
function, the analogous random variable Z* will be given by Z* = /(the 
array (10.4.2)) (with the same function /). Thus the analog of (6.1.3) is 




95 



the analog of (6.2.5) is 




— 5'spaced 



the analog of (6.2.6) is 



k-2 ' 



...), 



and so on. Along the way, corresponding analogs of the events ^^Jq^ and Qq 
in Section 6.2 and equation (6.3.1) are defined and denoted ^^^^^ and Qq. 

Of course because of (B) and (C) above, some of the new ("asterisk") 
random variables defined in this way will be exactly the same as the original 
counterparts in Sections 6, 7, and 8. 

(G) Now define the event 



By (6.3.2) and its "asterisk" counterpart {P{^Iq) = 1), one has that 



Also (for example), for every oj e 1]', Statements 6.3(A) (i)(ii)(iii) and their 
"asterisk" counterparts all hold. 

(H) The random variables formulated in Step 10.3 (L„ and (n, i) for 
n,i e N, and for n > 2), are defined (and positive integer- valued) at 
every uj e Q', by (10.4.5) and the second sentence in Step 10.3 itself. For 
those random variables, we will not need to refer to, and will therefore not 
formally define, "asterisk" counterparts. 

Step 10.5. (A) Refer to Step 10.4(B)(C). The portion of the array 
(10.4.2) involving indices k < —N' — 1 (and any n e N) coincides with the 
corresponding portion of the array (10.4.1). 



(B) In particular, for any k < -N' - 1, ^l''^^ = ^^^^ (that is, tk^\uj) = 
^j^\u!) for all a; e O). Hence W^^^^ = wj^^^ for every k < —N' — 1, since by 



(10.4.5) 



n' := Qonct^. 



(10.4.6) 



P{Q') = 1. 
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(6.2.5) (in both arrays (10.4.1) and (10.4.2)), for any k < -N' - 1 and any 

(10.5.1) W^:(^)(a;) = ^spaced {Cf\u),e,^'\u;),e,^'\u;),...) 

= ^spaced (^i^)(a;),ef (a;),^f (a;),...) = wi'\u). 

By the same type of argument, using (6.2.6) and (6.2.7) (in both arrays 

(10.4.1) and (10.4.2)) together with induction on n, one can show the fol- 
fowing two facts together: that ^*{n, k,j) = '^{n, k,j) for each n e N, each 
k < —N' — 1, and each j > 0, and that 

(10.5.2) VneN, VA;<-7V'-1, W*^""^ =wl''\ 

(C) Continuing to apply (A) above in the same way as in (B), one obtains 
for any k < —N' — 1 and n e N the foUowing equahties of random variables: 

ik = ik (sec (6.1.3)), = Wf, (see (6.3.6)), d^' ' = ' (see 

(7.1.1) and (7.1.2)), N* = Nk (see (7.1.4)), J*{n,k) = J{n,k) (see (7.1.7)), 
^ ^(n) ^^^^ ^7_3_^^^^ ^ ^(n) ^^^^ ^^ g ^)), and finally, from (7.5.1), 

(10.5.3) V/c<-iV'-l, X^ = Xk. 

Lemma 10.6. Refer to Step 10.3 (including equation (10.3.9)). Refer 
also to (10.4-5)-(10.4-6) and Step 10.4(H). Suppose n e N. Then for every 
(jj & Q' , the following statements hold: 

(10.6.1) V /c > Lr,{uj) + 1, W;^''\uj) = Wi''\uj); 

(10.6.2) V A; > H{n, l)(a;), 5*^"^ (a;) = 5^^\u;); 

(10.6.3) VA;>iy(n, l)(w), **(n, /c, 0)(w) = *(n, fc, 0)(w); and 
(10.6.4) 

V A; > H{n, l){u;), k - **(n, k,Q){uj) = k- ^{n, k,0){uj) > H{n, l){uj). 
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Proof. Throughout this proof, let a; e f2' be arbitrary but fixed. 
(Again recall Step 10.4(G) (H).) 

For each n e N, let the function <fn ■ ({0, 1})'' ^ {0, 1, 2, 3, 4, 5, 6} be 
as in Lemma 4.7. 

We shall first verify (10.6.1) and (10.6.2) for n = 1. For each i > 
Li(a;) - 5, one has that ^*''^\u;) = C?^(^) by (10.3.9) and Step 10.4(C). 
Hence for each integer k > Li{uj) + 1, by the "asterisk" counterpart of 
(6.2.5), then two applications of (10.3.6) and Lemma 4.7 together, followed 
by (6.2.5) itself, with Li{u>) written here as L(l)(a;), 

= ^spaced {a^'\oo),a^-l{^),C^-li-^),...) 
= Vk-L{l){u,) (CSM + l(^)'^L(i)M+2(^)' 
= V'fe-L(l)(a.) (^L(\)(c^) + l(^)'da)(c^)+2('^)' 
= £fspaced (Cfe^^(^), Cfe-l(^), ^k-2i^)^ ■ ■ ■) 

Thus (10.6.1) holds for n = 1. By (10.6.1) (for n = 1) and (7.1.1) (and 
its "asterisk" counterpart), ^^'•^■'(c<;) = S''^\u)) for all k > Li{iv) + 1 (and in 
particular for aU k > H{1, by (10.3.9)). Thus (10.6.2) holds for n = 1. 

Now we use induction. Suppose N E N, and suppose (for the given 
uj e Q') that (10.6.1) and (10.6.2) hold for n = N. For the induction step, 
we shall show (for the given uj e 0,') that (10.6.3) and (10.6.4) hold for 
n = N, and then show that (10.6.1) and (10.6.2) hold forn = AT + 1. This 
actually suffices to prove Lemma 10.6 by induction. 

Verification of (10.6.3)-(10.6.4) for n ^ N. Suppose k > H{N, l)(a;). 
Referring to (10.3.1) and (10.3.2), let m denote the positive integer such 
that H{N,m){ijj) < k < H{N,m+ l)(a^). By the inductive assumption of 
(10.6.1) for n = N, equation (10.3.2) holds forn = iV with W^^\u}) replaced 
by W^^^\u>). Hence by (6.2.6) and its "asterisk" analog (and Definition 
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2.2(A)), together with (10.3.1) and (10.3.2), 



= k-H{N, m)(a;) 



and hence also (see (10.3.1) again) 

k - **(7V, k, 0){u;) = k- *(7V, k, 0){uj) = H{N, m){uj) > H{N, l){uj). 

Thus (10.6.3) and (10.6.4) hold for n = N. 

Verification of (10.6.1) for n = N + 1. By (10.3.8) (see (10.3.7)) 
Ljv+i(<^) = H{N,^N+i{(^)){'^)- li k > Ljv+i(<^) + 1 but k is not one of the 
integers H{N,m){uj), m > $7V+i('^) + l, then wl^\uj) ^ 1 by ((10.3.1) and) 
(10.3.2) for n = N, hence W*^^^ = VT^^^ ^ 1 by ((10.3.9) and) the inductive 
assumption of (10.6.1) for n = N, and hence W^^^~^^\u>) = wj^^~^^\uj) = 
by both Remark 6.3(B) and its " asterisk" counterpart. Hence (see (10.3.1) 
again) to complete the proof of (10.6.1) for n = N + 1, what remains is to 
show that for each integer m > $7v+i(w) + 1, one has that W^^f^H. Au}) = 



Suppose m > ^n+i{uj) + 1. To obtain the desired equality, using the 
function (fy_ in Lemma 4.7 for the positive integer u := m — ^n+i{u!), using 
the convention in Notation 2.1(G), and writing the positive integer $jv+i(a^) 
as ^{N + l)(a;), we shall show that 



H{N,m){Lo) 



(10.6.5) 



^ H{N,m){uj)y^) 

= ^/spaced J e {i < H{N,m){u^) : W,*(^)(a;) = 1}) 




= ^spaced (ef j^{i< H{N,m){uj) : Wi''\uj) = 1}) 

- (, A 

- ^HiN,m)iuj)y'^)- 



(^)) 
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To verify this, first note that by (10.3.9) and Step 10.4(C), the equahty 
$l.^^'^^\co) = Ci^~^^\uj) holds for each k > H{N, l)(c<;), and in particular it 
holds for eachk of the form k = H{NJ){u) for i > $7V+i(t^) - 5 by (10.3.1) 
(with n = N) and (10.3.7) (with n = + 1). That trivially yields the third 
equality in (10.6.5). Next, by (10.3.1)-(10.3.2) and the inductive assumption 
of (10.6.1) for n = N, W*^^\oj) = wl^^\uj) = 1 for /c e {H{N,l){oj), 
H{N, 2){u;), H{N,3){uj), . . .}, and W*^^\u) - W^^^\uj) 7^ 1 for aU other 
k > H{N, l)(c<;). This fact has a couple of consequences: First (just consider 
that fact for k = H{N,m){u;)), by (6.2.14) and (6.2.9)-(6.2.10) and their 
"asterisk" counterparts (for n = N), the first and fifth (i.e. last) equalities 
in (10.6.5) hold. Then, by (10.3.7) with n = N +1 (combined with the 
observation in italics in the first sentence after (10.6.5)), one has from Lemma 
4.7 that the second and fourth equalities in (10.6.5) also hold. Thus (10.6.5) 
holds. That completes the proof of (10.6.1) for n — N + 1. 

Verification of (10.6.2) for n = N+1. Now suppose k > H{N + 1, l)(a;). 
Referring to (10.3.1) for n = N+1, let m e N be such that H{N+1, m){(jj) < 
k < HiN + l,m+l){u;). Now W^J^'^+^'l^^^^^iu;) = <^+;\,^)(^)(^) = 1 
by (10.3.2) (for n = AT + 1) and (10.6.1) for n = iV + 1 (just verified 
above), and hence W^H(ArVi,m)(^) ('^) = 1 and VT^^^^-^^^^^^^ (w) = 1 by Re- 
mark 6.3(B) (and its "asterisk" counterpart). Hence ^{N, k,0){u) < k — 
H{N + l,m){oj) by (6.2.6) (and Definition 2.2(A)), hence A;-*(7V, /c, 0)(a;) > 
H{N + 1, m){uj) > Ln+i{uj) + 1 (see (10.3.2) with n = AT + 1), hence 

(10.6.6) w^;i^ii;!,,o)(.)(-^) - <-ilkk,o)a-^) 

by (10.6.1) for n = A^ + l (verified above). Also (since k > H{N + l,m){u)) > 
H{N + 1, 1) (w) > H{N, 1) (w) by (10.3.9)) ^* {N, k, 0) (c^) = ^'(A^, k, 0) (w) by 
(10.6.3) ior n = N (verified above). Substituting that into the left hand 
side of (10.6.6) and then applying (7.1.2) and its "asterisk" counterpart, 
one obtains ^^'-'^"''"^^ (a;) = 5j^^'^^\uj). Thus (10.6.2) has been verified for 
n = A^^-l- 1. That completes the induction step and the proof of Lemma 10.6. 
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Step 10.7. For each n e N, each uj e fl' (see Step 10.4(G)), and each 
set 5 C R, define the sets 



(10.7.1) G(^)(5)(a;) := j/c e Z : /c e 5 and ^^^''^(a;) = l} 
and 

(10.7.2) G<''\S)ioj) :=\^keZ:keS and W*^''\oj) = l} . 

For each n e N, define the random sets and F* as follows: For each 
(jj e^l' (see Step 10.4(G) again), 

(10.7.3) F,(a;) :=G'(-)([-iV', L,(a;)])(a;) 

= j/c e Z : -N' <k< Ln{oj) and ^^^^""^(0;) = l} 

and 

(10.7.4) Tl{u) ■.=G<^\[-N',L^{u)]){u) 

= |/c e Z : -N' <k< Ln{uj) and W*^''\uj) = l}. 

For each n G N, by (10.7.3), (10.7.4), (10.3.3), and (6.2.1) and its "as- 
terisk" counterpart, one has that 

(10.7.5) ^(rn,r:) C a [t''\t''^) ■ 

Also, forn G N and uj G fl' , by (6.2.9) and (6.2.10), one has (see (10.7.1)) 
the following reformulation of (6.2.14) in the convention of Notation 2.1(G): 

(10.7.6) If A; G Z is such that wl"'\oo) = 1, 

then W^'^+'^uj) = ^spaced (^f +'^(a;), j e ((-00, A;])(a;)) . 

Analogously (see (10.7.2)), for n G N and uj G Q', 

(10.7.7) If /c G Z is such that VFfc^"^(a;) = 1, 

then W^^^'+'^u) = ^spaced j e G*H((-oo,A;])(a;)). 
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Lemma 10.8. For each n eN, 
(10.8.1) E{caTdTn) < 3N' and 



(10.8.2) E(cardr;) < 3N'. 

Proof. It suffices to give the argument for (10.8.1). The argument for 

(10.8.2) is exactly analogous. 

First, for each u e O', by (10.7.3), Ti{u) C {-iV', -iV' + 1, . . . , Li(a;)} 
and hence cardri(a;) < 1 + N' + Li{uj). Hence by (10.3.4) and (10.2.5), 

(10.8.3) £;(cardri) < l + iV' + £;Li 

<l + N' + N' + 6- (8/5)^° • (8/3)^ 
< 3N'. 

Next, for each n > 2 and each uj e n', by (10.7.3), (10.7.1), Remark 
6.3(C), (10.3.9), (10.3.1), (10.3.2), and (10.3.8), 

caTdVniuj) < 1 + (1/6) •cardG^"-^)([-7V',L„(a;)])(a;) 

= 1 + (1/6) • cardG'("-i)([-iV',L^_i(c^)])(a;) 

+ (1/6)- card G('^-i)((L„_i(a;),L,(a;)])(a;) 

= 1 + (1/6) •cardr^_i(a;) 

+ (1/6) • card{if(n - 1, l)(a;), H{n - 1, 2){io), 

...,H{n-l,^n{oj)){uj)} 

= 1 + (1/6) • cardr^_i(c^) + (1/6) • 

Hence for each n > 2, by (10.3.5) and (10.2.5), 

E(cardr„) < 1 + (1/6) • £;(cardrn-i) + (1/6) • E^n 

< 1 + (1/6) • E{cavdTn-i) + N'. 

Hence for any n e N such that £^(cardr„_i) < 3N', one trivially has that 
£;(cardr„) < 3N'. Hence by (10.8.3) and induction, (10.8.1) holds for all 
n G N. That completes the proof of Lemma 10.8. 
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Step 10.9. Recall the number s e (0, 1) fixed in the sentence containing 
(10.2.1). Let M be a positive integer sufficiently large that 



(10.9.1) 6N'/M < e. 

By Lemma 10.8, £'(card(r„ U F*)) < QN' for each positive integer n. 
Hence by Fatou's Lemma, 

E fliminf card(F„ UF;)) < 6iV'. 

Hence by Markov's inequality and (10.9.1), 

(10.9.2) P fliminf card(F„ U F*) > m] < 6N'/M < e. 

\ n— »oo / 

Next, define the number 6* e (0, 1) by 

(10.9.3) 9 (5/8)6^. 
Also, for each n> N', define the event 

(10.9.4) Bn := {card(Fn U F* ) < M} ; 

and for each n > N' + 1, define the event 
(10.9.5) 

Dr, := jo; e 1]' : ^^"^ (u) = (0, 0, 0, 0, 0, 0) for all k e F^_i (c^) U r;_i (c^) } . 
By (10.7.5), (10.9.4), and (10.9.5), 

(10.9.6) yn>N', Bnea(^^''\t^''^y, and 

(10.9.7) Vn>iV' + l, Dr^ea(^t^\P^^y 

Lemma 10.10. Refer to (10.9.3), (10.9.4), and (10.9.5). Suppose n > 
N', A e (j(C^"\r^''^), and P{A n Bn) > 0. Then P{Dn+i \AnBn)>e. 

Proof. By (10.9.4), the event B^ can be partitioned into an at most 
countable collection of events of the form {r„ flF* = 5} for sets S G Z such 
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that cards' < M (including the empty set). Accordingly, the event Ad Bn 
is partitioned into events A fl {r^^ n F* = S} for such S. 

For any such S such that P{A n {F„ n F* = S}) > 0, one has by 
(10.7.5) (and the hypothesis of Lemma 10.10 here) that A n {F„ n F* = 
S}^a{^"^ ,$,*^"'^) and is therefore independent of the sequence ^('^+^) (recall 
again Construction 6.1(A)(C)), and hence by (10.9.5), Construction 6.1(A) 
(including (6.1.1) there), and (10.9.3), 

p(i)^+i I An{F,nF;} = s) 

= P (^I"^'^ = (0, 0, 0, 0, 0, 0) V /c e s I ^ n {r„ n r* } = s) 

= ^ (ei''^'^ = (0, 0, 0, 0, 0, 0) V /c e s) 

= ((5/8)6)^^'^'^^ 

> (5/8)^^ = e. 

Lemma 10.10 now follows from Remark 2.8. 
Lemma 10.11. P (U^=Ar'+i ^n) > 1 - 2£. 

Here again of course the number e G (0, 1) is as fixed in the sentence 
containing (10.2.1). One can do better than Lemma 10.11, but that will not 
be necessary. 

Proof. Suppose Lemma 10.11 is false. That is, suppose instead that 

oo 

(10.11.1) s:=p( fl I^^)>2£. 

We shall aim for a contradiction. 

Referring to (10.9.3) and (10.11.1), let © be an integer such that 



(10.11.2) e>iV' + l and f] D^^<s + ee/2. 

n=N'+l 

In the arguments below, we shall use more compact notations for the events 
in (10.11.1) and (10.11.2): 

oo e 

(10.11.3) E:= [] D'^ and E' := fj D^^. 

n=N' + l n=N'+l 
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Referring to (10.11.2), (10.9.4) and (10.9.5), define the events Aj, j e 
{e + 1, G + 2, e + 3, . . .} U {oo} as follows: 



(10.11.4) 



^e+i := -Be+i; 



Vie{G + 2,G + 3,G + 4,...}, Aj:=Bjf](^ f| Sf); and 



i=e+i 



oo 



^oo:=( n ^0- 



i=e+l 



These events Ae+i, ^e+s, • • • and Aoo form a partitfon of Q. Also, by 

(10.11.4) and (10.9.4), A^ C {liminf^^oo card(r„ur;) > M + 1}, and hence 
by (10.9.2), P{A^) < e. Hence P{E' n A^o) < e. Now P{E') > P{E) > 2e 
by (10.11.3) and (10.11.1). Hence 



Now suppose j e {G + 1, G + 2, G + 3, . . .} is such that P{E' n Aj) > 0. 
(Then j > N'+2 by (10.11.2).) By (10.9.6), (10.9.7), (10.11.3), and (10.11.4) 
(and Constructions 6.1(A)(C)), E'nAjDBj = E' OAj ecr{^^^\C^^'^). Hence 
by Lemma 10.10, P{Dj+i\E' n Aj) > 6. Of course by (10.11.3) the events 
Dj+i and E are disjoint. It follows that P{E\E' n Aj) <l-e. 

Now by the sentence right after (10.11.4), the events E' fl Aj, j G {G + 
1, G + 2, G + 3, . . .} form a partition of the event E' n A^^. Hence by the 
calculations in the preceding paragraph, together with Remark 2.8, one has 
that P{E\E' n A"^) <l-d. Since E G E' (recaU (10.11.3)), this can be 
rewritten as P(£;nyl^) < {l-e)P{E'nAl^). Combining that with (10.11.5), 
one now has 



Since (again) E C E', one also has that P{E' n ^oo) - P{E n A^o) > 0. 
Combining that with (10.11.6), one obtains 



(10.11.5) 



P{E'nAl^)>e. 



(10.11.6) 



p{E' n A^) - P{E nAi^)>e- p{e' n A^) > Oe. 



(10.11.7) 



P{E') - P{E) > 9s. 
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However, by (10.11.1). (10.11.2). and (10.11.3), P{E') - P{E) < s + 
ed/2 — s = £^/2, which contradicts (10.11.7). Hence Lemma 10.11 must hold 
after all. 

Lemma 10.12. For every integer N > N' and every u e Djv+i? there 
exists a positive integer K = K{uj) such that Xl^{uj) = Xkiuj) for all k > K. 

Proof. Throughout this proof, let N and u) be fixed such that 

(10.12.1) N>N' and uj e Dn+i- 

Of course a; G O' by (10.9.5); and all properties of uj mentioned in the last 
sentence of Step 10.4(G) will be tacitly taken for granted here. 

Suppose k e {-N', -N' + 1, . . . , Ln{oo)} is such that W^^^\oj) = 1. 
Then k e r^(a;) by (10.7.4), hence ^i^^^\u;) = (0,0,0,0,0,0) by (10.12.1) 
and (10.9.5), and hence also .^^^^^^^(a;) = (0,0,0,0,0,0) by (10.12.1) and 
Step 10.4(C). Also (trivially) by (10.7.2), k = m8iX G<^\{- oo, k]){u), and 
hence (in the convention of Notation 2.1(G)) 

W<''+'\u;) = ^spaced (e;^^^'^(a;), 3 e G*W((-oo, k]){u;)) = 

by (10.7.7) and Lemma 4.8 (equation (4.8.1)). 

We have shown that (under the hypothesis of Lemma 10.12) 1^^'-^^^'' (a;) 
= for every k e {-N', -N' + 1, . . . ,Ln{u;)} such that W*^^^ (a;) = 1. For 
all other values of A; e {-AT', -N' + 1, . . . , Ln{oj)}, W^'^^'^^\oj) = by (the 
"asterisk" analog of) Remark 6.3(B). Hence W*^^^^\oo) = for aU e Z 
such that — A^' < k < Ln{uj). By an exactly analogous argument (using 
(10.7.3) and (10.7.1) instead of (10.7.4) and (10.7.2)), wl^^^\u;) = for aU 
such k. That is, 
(10.12.2) 

Vfc e {-AT', - AT' + 1, ... , Ln(u;)}, W;^''+^\uj) = wi^'+^Hu) = 0. 

Next, suppose u e N. Then W^jfJ^^^^^^iu;) - wif^l^^^^^^^iu) = 1 by 
Lemma 10.6 (equation (10.6.1)), (10.3.1), and (10.3.2); and hence by (10.7.7), 
(10.12.3) 

Wn%':ul)i^) = ^^Bpaced (e;^^+'^(a;), j e G*W((-oo,iy(Ar,«)(a;)])(a;)) . 
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Again, for every k e G* ^^\{- oo, H{N,u){uj)]){uj) such that -AT' < k < 
Ln{oj), one has that Ck^^^\u}) = (0,0,0,0,0,0), by (10.7.2) and the argu- 
ments in the paragraph after that of (10.12.1). Referring to (10.3.1)-(10.3.2) 
and applying Lemma 4.8 (equation (4.8.2)), one can delete those particular 
elements k from the set G* ^^\{— oo, H{N,u){ijj)]){(jj) without changing the 
right hand side of (10.12.3). That is, one obtains (see (10.7.2) and (10.3.1)- 
(10.3.2) again) 

(10.12.4) 

(^) = ^spaced (e;^^+'^(c.), J e G*W((-00, -N' - l])(c.) 

U G'*(^)([L^(a;) + 1, H{N,u){uj)]){uj)) 

= ^spaced (e;^'^+'^('^), j e G'*(^)((-00, -N' - l])(c^) 

U {H{N, l){co), H{N, 2) (a;), ... , H{N, «)(a;)}) 

Now by (10.12.1) and Step 10.4(C), C/^^^\u;) = ^f^^\u;) for every j e Z. 
Also, 

G<^\{-oo, -N' - = G(^)((-oo, -N' - l]){uj) 

by (10.7.1), (10.7.2), and (10.5.2). Hence by (10.12.4), 

(10.12.5) 

= ^spaced (a;), j e G(^n(-oo, -N' - l])(a;) 

U {H{N, 1) (a;), H{N, 2) (a;), ... , H{N, u) (a;)}) . 

By an exactly analogous argument, one obtains 

= (10.12.5)], 

and hence by (10.12.5) itself, 

(10.12.6) ^^^;V(c.)(^) = ^HiN^a^)- 

Equation (10.12.6) was obtained for arbitrary tt e N. For all other k > 

Liv(w) + 1 besides {H{N, l)(w), H{N, 2) (c^;), ...,}, one has that W*^^\uj) = 
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Wf\u) 7^ 1 by Lemma 10.6 (equation (10.6.1)) and (10.3.2), and hence 
^*(jv+i)^^^ = Wl^^^^\uj) = by Remark 6.3(B) and its "asterisk" coun- 
terpart. Combining that with (10.12.6), one now has that 

(10.12.7) V/c > Ln{u;) + 1, ^^^('^+'^(0;) = W^''+'\io). 
Now by (10.12.2), (10.12.7), and (10.5.2), one now has that 

(10.12.8) V/ceZ, W;^''+^\u) = W^''+^\uj). 

Now recall from Step 10.4(C) that Ck^'^\uj) = C'i^\uj) for all n > iV' + 1 
and all /c e Z. Recall (10.12.1) again. Starting with (10.12.8) and using 
(6.2.6) and (6.2.7) (and their "asterisk" counterparts) and induction on n, 
one has that 

(10.12.9) Vn > iV + 1, V/c e Z, W*^''\oj) = ^^^""^(0;); and 

(10.12.10) Vn > iV + 1, V/c e Z, Vj > 0, ^*(n,kj)(u;) = ^(n,kj)(u;). 

Now recall (10.3.9). Our candidate for the integer K = K{(jj) in Lemma 
10.12 wiU be H(N,l)(oj). 

By (10.3.9) and Step 10.4(B), one has that 

(10.12.11) \/k>H{N,l){oj), X*(°)(a;) = xf\a;). 

Now keep in mind that H{N, l){uj) > H{n, l){oj) for all n e {1, . . . , N} 
by (10.3.9). By (6.3.5) and Lemma 10.6 (equation (10.6.4), applied twice), 
one has that 

(10.12.12) Vn e {l,...,iV}, yk> H(N,l){oj), 

k - ^*{n, k, 0){u) = /c - ^'(n, k, 0){u) >k- ^'(iV, k, 0){u) 

>H{N,l){u). 

By Lemma 10.6 (equation (10.6.2)), 

(10.12.13) yne{l,...,N},yk>H{N,l){u), 5*^"^(a;) = ^"^(a;). 
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Also, by (7.1.2) and its "asterisk" counterpart, equation (10.12.12) for n = N, 
and equation (10.12.8), 

(10.12.14) V/c > H{N, l)(a;), ^^^'^+'^(0;) = 4"^+'^ (a;). 

Next, recall from Step 10.4(C) (and (7.3.1) and its "asterisk" counterpart) 
that Cl^^'Huj) = Ci''\uj) for all n e N and all k > N' + l. Since H{N, l){uj) > 
iV' + 1 by (10.3.9), one has by (10.12.12) that 

(10.12.15) Vn e {l,...,iV}, yk> H{N,l){uj), 

Next by Step 10.4(C) and (10.12.1), one has that for every n> N + 1 
(in fact every n > N' + 1) and every /c e Z, Cfc*'"^''('^) = Cfc"^'*('^)- Hence 
by (10.12.10), for every n > TV + 1 and every k e Z, C^?^*(„,fc,o)(a.)(^) = 
Cl-*(n,fc,o)(c.)('^)- Also, by (10.12.9), (10.12.10), and (7.1.2) and its "aster- 
isk" counterpart, for every n > N + 2 and every G Z, dl^^\u!) — d^^\u!). 
Combining these facts with (10.12.13), (10.12.14), and (10.12.15), one now 
has that 

(10.12.16) WneN, Wk>H{N,l){io), Sl'^''\u;) = Si^\ioy, and 
(10.12.17) 

Vn e N, V/c > H{N, l)(a;), C%^r^,kM^)i^^ = Ci-*(n,.,o)(.)(^)- 

By (7.1.7) and (7.1.4) and their "asterisk" counterparts, together with 
(10.12.16), one obtains 

(10.12.18) Vn e N, V/c > iy(iV, l)(a;), J* (n,k){uj) = J{n,k){uj); and 

(10.12.19) V/c > Jf(iV, l)(cj), Nl{u) = Nk{uj). 

Now by (7.5.1) (and its "asterisk" counterpart), (10.12.11), (10.12.17) 
(recaU (7.3.1) and its "asterisk" counterpart), (10.12.18), and (10.12.19), one 
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has that X*{uj) = Xk{uj) for all k > H{N, Thus Lemma 10.12 holds 

with K = K{uo) = H{N, l)(w). 

Step 10.13. By Lemma 10.12 and Lemma 10.11, 

(10.13.1) p([j{X*^ = Xkyk>J}\>pl Q Dn\>l-2s. 

\JeN / \n=N' + l J 

Also (trivially) for each J e N, 

{X* = v/c > J} c {X* = Xkyk>j + 1}. 

Hence by (10.13.1), limj^oo PiX^ = V/c > J) > 1 - 2£. Accordingly, let 
J' be a positive integer such that 

(10.13.2) J' >N' + 1 and 

(10.13.3) P (X^ = Xfe V/c > J') > 1 - Ss. 

Now recall (10.1.1). One has that F' e a{Xk, \k\ > J'). Thus (see e.g. 
[1, Theorem 20.1(i), trivially extended], and recall property (A) in Theorem 
1.1) there exists a Borel set B' C {—1,1}'^ such that 

(10.13.4) F' = {{Xj,, Xj.+i, Xj,+2, X_j._2, ...)eB'} 
Define the ("asterisk counterpart") event 

(10.13.5) F'" := {{X},, X*_j,, X},_^i, X*_j,_^, -'^j'+2: ^-j'-2^ . . . ) G B'] 
By (10.13.2), (10.13.3), and (10.5.3), 

P {X* = Xk for all e Z such that \k\ > J') > 1 - 3s. 
Hence by (10.13.4), (10.13.5), and a simple argument, 

(10.13.6) P{F'AF"')<3£ 
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(where A denotes symmetric difference). Hence by a simple standard argu- 
ment, 

(10.13.7) P{F"') < P{F') + 3e. 

Refer to Construction 7.4(B). By Lemma 7.6 (and Remark 2.6(B)), one 
has that a{X)Ga{r]), the cr-field generated by the array (10.4.1). The "aster- 
isk" counterpart is a{X*)ca{r]*), the d-field generated by the array (10.4.2). 
Hence by (10.4.4) and (10.13.5), 

(10.13.8) the events F" and F'" are independent. 

Now by (10.2.3), (10.13.6), and a standard elementary argument (see 
e.g. [5, Vol. 1, Appendix, Section A053(V)]), 

P{{F" n F'") A F') = P{{F" n F'") A {F' n F')) 

< P{F" A F') + P{F"' A F') < As. 

Hence by a standard simple argument, P{F" D F'") > P{F') — 4e. Hence by 
(10.13.8), (10.2.4), and (10.13.7), 

P{F') -Ae< P{F" n F'") = P{F") ■ P{F"') 
<[P(F')+£]-[P(F') + 3£]. 

However, that contradicts (10.2.1). Hence (10.1.2) must be false, and 
7doubie(-^) is trivial after all. That completes the proof of Property (D) in 
Theorem 1.1, and of Theorem 1.1 itself. 
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